[TestSuiteProgress] Test starting: org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest.testPrimaryOwnerIsolatedPartition[DIST_SYNC] 14:54:28,129 INFO [org.infinispan.commons.test.TestSuiteProgress] (TestNG) Test starting: org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest.testPrimaryOwnerIsolatedPartition[DIST_SYNC] 14:54:28,129 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) About to wire and start cache opt-cache 14:54:28,131 TRACE [org.infinispan.factories.InterceptorChainFactory] (TestNG) Finished building default interceptor chain. 14:54:28,131 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (TestNG) starting distribution manager on test-NodeA-55522 14:54:28,132 DEBUG [org.infinispan.commons.util.ServiceFinder] (TestNG) No service impls found: FilterIndexingServiceProvider 14:54:28,132 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@63b8b1bc for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,132 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@2c4dfdb5 for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,132 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain size: 12 14:54:28,132 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@431987d5 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@2576cd2b >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@365bd68 >> org.infinispan.statetransfer.StateTransferInterceptor@408658e4 >> org.infinispan.statetransfer.TransactionSynchronizerInterceptor@4fae480e >> org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor@5ca2db45 >> org.infinispan.interceptors.impl.TxInterceptor@7282b344 >> org.infinispan.interceptors.locking.OptimisticLockingInterceptor@318488 >> org.infinispan.interceptors.impl.NotificationInterceptor@3d6242b8 >> org.infinispan.interceptors.impl.VersionedEntryWrappingInterceptor@77d0cea2 >> org.infinispan.interceptors.distribution.VersionedDistributionInterceptor@10af5b8f >> org.infinispan.interceptors.impl.CallInterceptor@1cb698d6 14:54:28,132 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@33ee7e7a for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,132 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@423a137b for interface org.infinispan.notifications.cachelistener.annotation.PartitionStatusChanged 14:54:28,133 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) Starting DefaultConflictManager. isRunning=false 14:54:28,133 TRACE [org.infinispan.transaction.xa.TransactionFactory] (TestNG) Setting factory enum to NODLD_NORECOVERY_XA 14:54:28,133 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@28a35b90 for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,133 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@fb067a for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,133 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@4026b5b1 for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isAffectedByRehash 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isLocatedLocally 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation java.util.List locateKey 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationCount [r=true,w=false,is=false,type=long] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 14:54:28,133 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationFailures [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute sitesView [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void setStatisticsEnabled 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictionSize [r=true,w=true,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute prepares [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rollbacks [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute commits [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute storeWrites [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute staleStatsThreshold [r=true,w=true,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute currentNumberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute invalidations [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute elapsedTime [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,134 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void disconnectSource 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,135 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void recordKnownGlobalKeyset 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@142b7168 under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@633b135b under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Passivation 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@17cf5b6 under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@23c027ee under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RpcManager 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@6c2fa2cf under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@57b5d5da under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Activation 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@31825bdf under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Configuration 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@13dff556 under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=LockManager 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@2770438 under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Transactions 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@7b151aa9 under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 14:54:28,135 DEBUG [org.infinispan.jmx.JmxUtil] (TestNG) Object name infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@586aeab7 under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Statistics 14:54:28,135 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@3473d1a9 under infinispan-9188ba24-a5cb-422e-a5b1-0f101510a23d:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 14:54:28,135 TRACE [org.infinispan.jmx.CacheJmxRegistration] (TestNG) ISPN000031: MBeans were successfully registered to the platform MBean server. 14:54:28,135 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Starting StateTransferManager of cache opt-cache on node test-NodeA-55522 14:54:28,135 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Node test-NodeA-55522 joining cache opt-cache 14:54:28,135 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeA-55522, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=392a5da1-6e12-417a-b1a8-c0042ca205f4, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,135 TRACE [org.infinispan.topology.ClusterCacheStatus] (TestNG) Cache opt-cache initialized. Persisted state? false 14:54:28,135 TRACE [org.infinispan.topology.ClusterCacheStatus] (TestNG) Added joiner test-NodeA-55522 to cache opt-cache with persistent uuid 392a5da1-6e12-417a-b1a8-c0042ca205f4: members = [test-NodeA-55522], joiners = [test-NodeA-55522] 14:54:28,135 TRACE [org.infinispan.topology.ClusterCacheStatus] (TestNG) Initializing status for cache opt-cache 14:54:28,136 TRACE [org.infinispan.topology.ClusterCacheStatus] (TestNG) Cache opt-cache topology updated: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]}, members = [test-NodeA-55522], joiners = [] 14:54:28,136 TRACE [org.infinispan.topology.CacheTopology] (TestNG) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,136 TRACE [org.infinispan.topology.ClusterCacheStatus] (TestNG) Cache opt-cache stable topology updated: members = [test-NodeA-55522], joiners = [], topology = CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,136 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (TestNG) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,136 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} 14:54:28,136 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} 14:54:28,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (TestNG) test-NodeA-55522: sending test-NodeA-55522#22 14:54:28,136 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=22], TP: [cluster_name=ISPN] 14:54:28,136 TRACE [org.jgroups.protocols.MFC] (TestNG) test-NodeA-55522 used 2186 credits, 1922484 remaining 14:54:28,136 DEBUG [org.infinispan.topology.ClusterCacheStatus] (TestNG) Queueing rebalance for cache opt-cache with members [test-NodeA-55522] 14:54:28,136 TRACE [org.infinispan.topology.ClusterCacheStatus] (TestNG) Rebalancing consistent hash for cache opt-cache, members are [test-NodeA-55522] 14:54:28,136 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=2186 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=22], TP: [cluster_name=ISPN] 14:54:28,136 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=2186 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=22], TP: [cluster_name=ISPN] 14:54:28,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#22 14:54:28,136 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=2186 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=22], TP: [cluster_name=ISPN] 14:54:28,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#22 14:54:28,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#22 14:54:28,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#22 14:54:28,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#22 14:54:28,136 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#22 14:54:28,136 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} 14:54:28,136 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} 14:54:28,136 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,136 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,136 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} 14:54:28,136 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,136 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 2186 credits, 1971298 remaining 14:54:28,136 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,136 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,136 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,136 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 2186 credits, 1922484 remaining 14:54:28,136 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 2186 credits, 1945164 remaining 14:54:28,136 TRACE [org.infinispan.topology.ClusterCacheStatus] (TestNG) The balanced CH is the same as the current CH, not rebalancing 14:54:28,136 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating local topology for cache opt-cache: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,136 TRACE [org.infinispan.topology.CacheTopology] (TestNG) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,136 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Installing new cache topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} on cache opt-cache 14:54:28,136 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) This is the first topology 1 in which the local node is a member 14:54:28,136 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,136 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,136 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,136 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) (isRunning=true) Installed new topology 1: CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,136 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling topology 1 is installed 14:54:28,136 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Unable to acquire cluster listeners from other members, assuming none are present 14:54:28,136 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) On cache opt-cache we have: added segments: [] 14:54:28,136 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,137 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling transaction data received for topology 1 14:54:28,137 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,137 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,137 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Removing no longer owned entries for cache opt-cache 14:54:28,137 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,137 DEBUG [org.infinispan.transaction.impl.TransactionTable] (TestNG) Topology changed, recalculating minTopologyId 14:54:28,137 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Changing minimum topology ID from -1 to 1 14:54:28,137 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,137 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Initial state transfer complete for cache opt-cache on node test-NodeA-55522 14:54:28,137 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} is stable. Last stable topology is null 14:54:28,137 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating stable topology for cache opt-cache: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,137 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,137 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) On stable topology update. Pending txs: 0 14:54:28,137 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) StateTransferManager of cache opt-cache on node test-NodeA-55522 received initial topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,137 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=test-NodeA-55522, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,137 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Waiting for initial state transfer to finish for cache opt-cache on test-NodeA-55522 14:54:28,137 DEBUG [org.infinispan.cache.impl.CacheImpl] (TestNG) Started cache opt-cache on test-NodeA-55522 14:54:28,137 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) Cache opt-cache started 14:54:28,137 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) About to wire and start cache opt-cache 14:54:28,138 TRACE [org.infinispan.factories.InterceptorChainFactory] (TestNG) Finished building default interceptor chain. 14:54:28,139 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (TestNG) starting distribution manager on test-NodeB-18592 14:54:28,139 DEBUG [org.infinispan.commons.util.ServiceFinder] (TestNG) No service impls found: FilterIndexingServiceProvider 14:54:28,139 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@78e8cdc0 for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,139 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@c2dfe9b for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,139 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain size: 12 14:54:28,139 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@37ad0ab3 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@a33d79 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@3e9b7660 >> org.infinispan.statetransfer.StateTransferInterceptor@5da19e0e >> org.infinispan.statetransfer.TransactionSynchronizerInterceptor@286ff9b >> org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor@1bd75247 >> org.infinispan.interceptors.impl.TxInterceptor@7e9a1f2b >> org.infinispan.interceptors.locking.OptimisticLockingInterceptor@2f9abf18 >> org.infinispan.interceptors.impl.NotificationInterceptor@1a55f757 >> org.infinispan.interceptors.impl.VersionedEntryWrappingInterceptor@3b31db30 >> org.infinispan.interceptors.distribution.VersionedDistributionInterceptor@157cf83a >> org.infinispan.interceptors.impl.CallInterceptor@6f64e7f2 14:54:28,139 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@5a3e4a06 for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,139 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@6f63e22a for interface org.infinispan.notifications.cachelistener.annotation.PartitionStatusChanged 14:54:28,139 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) Starting DefaultConflictManager. isRunning=false 14:54:28,139 TRACE [org.infinispan.transaction.xa.TransactionFactory] (TestNG) Setting factory enum to NODLD_NORECOVERY_XA 14:54:28,139 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@1d2c7ad4 for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,139 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@553f45f4 for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,139 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@7d794b2f for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationCount [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationFailures [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute sitesView [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void setStatisticsEnabled 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation java.util.List locateKey 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isAffectedByRehash 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isLocatedLocally 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute commits [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute prepares [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rollbacks [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictionSize [r=true,w=true,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute storeWrites [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute invalidations [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute staleStatsThreshold [r=true,w=true,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute currentNumberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void recordKnownGlobalKeyset 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void disconnectSource 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute elapsedTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,140 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@1fddcd41 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RpcManager 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@7d84f9a8 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@211029db under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@7bdb6247 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@a1d1fb8 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Activation 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@508eeeea under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Transactions 14:54:28,140 DEBUG [org.infinispan.jmx.JmxUtil] (TestNG) Object name infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@70f05bd1 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=LockManager 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@5099d6d2 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Passivation 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@329be3a6 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Configuration 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@15c5b2a1 under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@67994d1b under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 14:54:28,140 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@7928287c under infinispan-465d49c0-44bf-47c4-b62e-3570705035d8:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Statistics 14:54:28,140 TRACE [org.infinispan.jmx.CacheJmxRegistration] (TestNG) ISPN000031: MBeans were successfully registered to the platform MBean server. 14:54:28,140 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Starting StateTransferManager of cache opt-cache on node test-NodeB-18592 14:54:28,140 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Node test-NodeB-18592 joining cache opt-cache 14:54:28,141 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeB-18592 sending request 10 to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeB-18592, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a513842f-3b63-47f4-8e08-30d8a40bd0c5, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,141 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeB-18592 --> DATA(test-NodeA-55522: #25, conn_id=0) 14:54:28,141 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,141 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=94 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,141 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #25, conn_id=0) 14:54:28,141 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#25 14:54:28,141 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 10 from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeB-18592, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a513842f-3b63-47f4-8e08-30d8a40bd0c5, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,141 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeB-18592, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a513842f-3b63-47f4-8e08-30d8a40bd0c5, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,141 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,141 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Added joiner test-NodeB-18592 to cache opt-cache with persistent uuid a513842f-3b63-47f4-8e08-30d8a40bd0c5: members = [test-NodeA-55522, test-NodeB-18592], joiners = [test-NodeB-18592] 14:54:28,141 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Queueing rebalance for cache opt-cache with members [test-NodeA-55522, test-NodeB-18592] 14:54:28,141 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Rebalancing consistent hash for cache opt-cache, members are [test-NodeA-55522, test-NodeB-18592] 14:54:28,142 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Updating cache opt-cache topology for rebalance: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,142 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, members = [test-NodeA-55522, test-NodeB-18592], joiners = [test-NodeB-18592] 14:54:28,142 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,142 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,142 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 2@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592] 14:54:28,142 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000310: Starting cluster-wide rebalance for cache opt-cache, topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,142 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100002: Started rebalance with topology id 2 14:54:28,142 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,142 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,142 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#23 14:54:28,142 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating local topology for cache opt-cache: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,142 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=23], TP: [cluster_name=ISPN] 14:54:28,142 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,142 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,142 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,142 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 5365 credits, 1917119 remaining 14:54:28,142 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t4) Installing new cache topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,142 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 10 to test-NodeB-18592: SuccessfulResponse(StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]}, stableTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]}}) 14:54:28,142 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=5365 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=23], TP: [cluster_name=ISPN] 14:54:28,142 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=5365 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=23], TP: [cluster_name=ISPN] 14:54:28,142 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#23 14:54:28,142 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#23 14:54:28,142 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,142 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#23 14:54:28,142 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=5365 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=23], TP: [cluster_name=ISPN] 14:54:28,142 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#23 14:54:28,142 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,142 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #10, conn_id=0) 14:54:28,142 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 14:54:28,142 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,142 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,142 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,142 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,142 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 5365 credits, 1917119 remaining 14:54:28,142 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=4282 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=10, TP: [cluster_name=ISPN] 14:54:28,142 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#23 14:54:28,142 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #10, conn_id=0) 14:54:28,142 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, newTopologyId=2} 14:54:28,143 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,143 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t4) (isRunning=true) Installed new topology 2: CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,143 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Start keeping track of keys for rebalance 14:54:28,143 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,143 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t4) Tracking is disabled. Clear tracker: {} 14:54:28,143 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t4) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,143 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling topology 2 is installed 14:54:28,142 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#23 14:54:28,143 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,142 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#10 14:54:28,143 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,143 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 5365 credits, 1965933 remaining 14:54:28,143 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,143 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,143 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,143 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring rebalance 2 for cache opt-cache that doesn't exist locally 14:54:28,143 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Topology update processed, stateTransferTopologyId = 2, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} 14:54:28,143 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling transaction data received for topology 2 14:54:28,143 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,143 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Finished receiving of segments for cache opt-cache for topology 2. 14:54:28,143 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,143 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 5365 credits, 1939799 remaining 14:54:28,143 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeC-p146-t5) Ignoring rebalance 2 for cache opt-cache that doesn't exist locally 14:54:28,143 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 10 from test-NodeA-55522: SuccessfulResponse(StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]}, stableTopology=CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]}}) 14:54:28,143 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Stop keeping track of changed keys for state transfer in topology 2 14:54:28,143 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,143 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t4) Tracking is disabled. Clear tracker: {} 14:54:28,143 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,143 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating local topology for cache opt-cache: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,143 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,143 TRACE [org.infinispan.topology.CacheTopology] (TestNG) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,143 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Installing new cache topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} on cache opt-cache 14:54:28,143 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,143 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,143 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,143 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 2 14:54:28,143 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Topology changed, recalculating minTopologyId 14:54:28,143 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,143 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Changing minimum topology ID from 1 to 2 14:54:28,143 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Received new topology for cache opt-cache, isRebalance = false, isMember = false, topology = CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,143 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) (isRunning=true) Installed new topology 1: CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,143 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 2 14:54:28,143 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling topology 1 is installed 14:54:28,143 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,143 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Requesting cluster listeners of cache opt-cache from node test-NodeA-55522 14:54:28,143 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t1) Rebalance confirmation collector 2@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592] 14:54:28,143 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,143 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) Check if topology CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,143 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) On stable topology update. Pending txs: 0 14:54:28,143 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeB-18592 sending request 11 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} 14:54:28,143 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeB-18592 --> DATA(test-NodeA-55522: #26, conn_id=0) 14:54:28,143 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,143 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=20 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,143 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #26, conn_id=0) 14:54:28,143 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#26 14:54:28,143 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 11 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=null, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} 14:54:28,144 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} [sender=test-NodeB-18592] 14:54:28,144 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,144 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} 14:54:28,144 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-thread-test-NodeA-p130-t6) Request received to get cluster listeners currently registered 14:54:28,144 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-thread-test-NodeA-p130-t6) Cluster listeners found [] 14:54:28,144 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 11 to test-NodeB-18592: SuccessfulResponse([]) 14:54:28,144 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #11, conn_id=0) 14:54:28,144 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 14:54:28,144 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=11, TP: [cluster_name=ISPN] 14:54:28,144 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #11, conn_id=0) 14:54:28,144 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#11 14:54:28,144 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 11 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,144 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_CACHE_LISTENERS, topologyId=1, segments=null} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,144 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) On cache opt-cache we have: added segments: [] 14:54:28,144 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,144 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling transaction data received for topology 1 14:54:28,144 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,144 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,144 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,144 DEBUG [org.infinispan.transaction.impl.TransactionTable] (TestNG) Topology changed, recalculating minTopologyId 14:54:28,144 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Changing minimum topology ID from -1 to 1 14:54:28,144 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, unionConsistentHash=null, newTopologyId=1} 14:54:28,144 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=1, rebalanceId=1, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} is stable. Last stable topology is null 14:54:28,144 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating stable topology for cache opt-cache: CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,144 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,144 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) On stable topology update. Pending txs: 0 14:54:28,144 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) StateTransferManager of cache opt-cache on node test-NodeB-18592 received initial topology CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,144 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeB-18592 sending request 12 to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=test-NodeB-18592, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,144 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Updating local topology for cache opt-cache: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,144 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeB-18592 --> DATA(test-NodeA-55522: #27, conn_id=0) 14:54:28,144 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,144 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,144 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,144 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,144 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=20 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,144 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #27, conn_id=0) 14:54:28,144 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#27 14:54:28,144 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 12 from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:28,144 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeB-18592] 14:54:28,144 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) Installing new cache topology CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,144 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,144 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) This is the first topology 2 in which the local node is a member 14:54:28,144 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 12 to test-NodeB-18592: SuccessfulResponse(true) 14:54:28,144 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #12, conn_id=0) 14:54:28,144 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,144 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 14:54:28,145 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,145 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,145 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=12, TP: [cluster_name=ISPN] 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #12, conn_id=0) 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#12 14:54:28,145 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 12 from test-NodeA-55522: SuccessfulResponse(true) 14:54:28,145 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, newTopologyId=2} 14:54:28,145 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Waiting for initial state transfer to finish for cache opt-cache on test-NodeB-18592 14:54:28,145 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t2) (isRunning=true) Installed new topology 2: CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,145 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Start keeping track of keys for rebalance 14:54:28,145 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,145 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Tracking is disabled. Clear tracker: {} 14:54:28,145 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,145 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling topology 2 is installed 14:54:28,145 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: new segments: {0-255}; old segments: [] 14:54:28,145 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: added segments: {0-255}; removed segments: {} 14:54:28,145 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Adding inbound state transfer for segments {0-255} 14:54:28,145 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Requesting transactions from node test-NodeA-55522 for segments {0-255} 14:54:28,145 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=2, segments={0-255}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,145 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 sending request 13 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=2, segments={0-255}} 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 --> DATA(test-NodeA-55522: #28, conn_id=0) 14:54:28,145 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,145 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1578 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #28, conn_id=0) 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#28 14:54:28,145 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 13 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=2, segments={0-255}} 14:54:28,145 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=2, segments={0-255}} [sender=test-NodeB-18592] 14:54:28,145 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,145 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=2, segments={0-255}} 14:54:28,145 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Received request for transactions from node test-NodeB-18592 for cache opt-cache, topology id 2, segments {0-255} 14:54:28,145 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Found 0 transaction(s) to transfer 14:54:28,145 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 13 to test-NodeB-18592: SuccessfulResponse([]) 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #13, conn_id=0) 14:54:28,145 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 14:54:28,145 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #13, conn_id=0) 14:54:28,145 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#13 14:54:28,145 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 13 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,146 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=2, segments={0-255}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,146 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:28,146 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Adding transfer from test-NodeA-55522 for segments {0-255} 14:54:28,146 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Finished adding inbound state transfer for segments {0-255} 14:54:28,146 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Topology update processed, stateTransferTopologyId = 2, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} 14:54:28,146 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling transaction data received for topology 2 14:54:28,146 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {0-255} 14:54:28,146 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,146 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,146 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=2, segments={0-255}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,146 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 sending request 14 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=2, segments={0-255}} 14:54:28,146 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,146 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 --> DATA(test-NodeA-55522: #29, conn_id=0) 14:54:28,146 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Topology changed, recalculating minTopologyId 14:54:28,146 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Changing minimum topology ID from 1 to 2 14:54:28,146 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,146 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=2} 14:54:28,146 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) Check if topology CacheTopology{id=2, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,146 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) On stable topology update. Pending txs: 0 14:54:28,146 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1578 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,146 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #29, conn_id=0) 14:54:28,146 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#29 14:54:28,146 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 14 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=2, segments={0-255}} 14:54:28,146 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=2, segments={0-255}} [sender=test-NodeB-18592] 14:54:28,146 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,146 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=2, segments={0-255}} 14:54:28,146 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Starting outbound transfer to node test-NodeB-18592 for cache opt-cache, topology id 2, segments {0-255} 14:54:28,146 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Adding outbound transfer to test-NodeB-18592 for segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 14:54:28,146 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 14 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,146 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #14, conn_id=0) 14:54:28,146 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 14:54:28,146 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t3) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 14:54:28,146 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 14:54:28,146 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #14, conn_id=0) 14:54:28,146 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#14 14:54:28,146 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=2, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,146 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 14 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,146 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=2, segments={0-255}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,146 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {0-255} 14:54:28,146 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={0-255}, finishedSegments={}, unfinishedSegments={0-255}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@49c2f2cb[Not completed], topologyId=2, timeout=240000, cacheName=opt-cache} 14:54:28,147 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 sending request 8 to test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=2, applyState=true} 14:54:28,147 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 --> DATA(test-NodeB-18592: #15, conn_id=0) 14:54:28,147 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 14:54:28,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=2603 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 14:54:28,147 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #15, conn_id=0) 14:54:28,147 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#15 14:54:28,147 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 8 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=2, applyState=true} 14:54:28,147 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=2, applyState=true} [sender=test-NodeA-55522] 14:54:28,147 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeB-18592) Checking if transaction data was received for topology 2, current topology is 2 14:54:28,147 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,147 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=2, applyState=true} 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 4 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 2 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 0 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 3 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 2 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 1 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 255 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 4 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 254 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 1 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 3 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 0 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 252 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 253 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 6 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 251 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 5 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 5 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 6 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 250 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 249 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 7 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 9 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 11 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 9 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 8 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 8 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 7 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 11 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 10 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 247 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 248 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 10 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 246 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 244 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 245 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 13 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 12 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 14 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 15 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 14 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 15 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 13 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 242 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 16 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 16 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 243 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 240 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 12 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 18 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 239 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 241 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 18 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 17 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 238 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 17 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 237 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 22 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 20 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 19 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 22 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 19 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 20 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 236 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 21 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 24 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 24 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 234 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 235 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 23 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 21 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 25 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 232 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 233 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 23 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 25 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 231 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 230 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 26 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 28 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 26 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 27 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 229 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 30 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 30 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 27 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 228 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 29 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 28 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 227 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 226 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 31 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 32 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 31 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 225 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 29 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 32 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 224 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 223 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 34 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 35 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 33 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 37 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 35 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 34 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 36 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 222 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 37 of cache opt-cache 14:54:28,148 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 33 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 36 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 221 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 219 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 220 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 218 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 38 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 41 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 38 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 41 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 39 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 216 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 40 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 43 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 43 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 217 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 215 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 39 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 42 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 40 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 42 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 214 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 213 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 44 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 44 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 212 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 211 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 48 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 48 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 47 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 45 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 46 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 45 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 210 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 209 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 47 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 208 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 51 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 46 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 49 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 50 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 51 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 207 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 206 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 53 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 52 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 50 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 49 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 205 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 52 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 53 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 203 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 204 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 55 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 55 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 201 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 202 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 54 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 56 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 54 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 56 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 200 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 199 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 57 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 59 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 61 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 59 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 58 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 198 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 60 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 57 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 61 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 197 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 60 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 58 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 196 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 195 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 64 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 194 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 62 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 63 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 62 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 64 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 193 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 192 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 63 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 65 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 191 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 67 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 66 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 68 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 67 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 68 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 65 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 190 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 70 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 66 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 69 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 188 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 189 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 187 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 70 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 69 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 186 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 185 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 71 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 72 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 74 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 71 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 74 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 73 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 72 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 73 of cache opt-cache 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 184 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 182 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 181 14:54:28,149 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 183 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 77 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 75 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 76 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 75 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 77 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 180 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 179 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 76 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 81 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 79 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 178 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 80 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 78 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 80 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 79 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 177 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 81 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 176 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 78 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 174 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 83 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 175 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 84 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 82 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 83 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 84 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 173 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 82 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 172 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 171 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 85 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 89 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 87 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 86 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 87 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 85 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 170 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 89 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 168 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 88 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 90 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 88 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 167 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 90 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 91 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 166 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 169 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 86 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 91 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 165 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 164 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 92 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 96 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 92 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 93 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 163 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 94 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 95 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 94 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 162 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 93 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 96 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 161 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 95 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 160 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 159 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 97 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 98 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 101 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 100 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 98 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 158 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 97 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 99 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 101 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 100 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 99 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 157 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 154 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 155 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 156 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 103 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 105 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 106 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 105 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 104 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 153 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 102 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 102 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 106 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 103 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 151 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 152 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 108 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 107 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 104 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 108 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 150 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 149 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 107 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 148 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 147 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 112 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 110 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 109 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 111 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 112 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 111 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 110 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 146 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 109 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 144 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 145 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 143 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 114 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 115 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 114 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 116 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 117 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 116 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 113 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 113 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 140 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 142 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 117 of cache opt-cache 14:54:28,150 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 141 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 139 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 115 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 120 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 118 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 119 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 119 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 118 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 137 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 120 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 138 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 136 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 135 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 121 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 122 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 124 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 122 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 121 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 134 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 124 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 123 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 132 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 133 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 127 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 127 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 123 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 125 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 130 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 131 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 126 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 126 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 128 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 129 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 129 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 130 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 129 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 128 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 128 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 127 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 130 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 125 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 126 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 125 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 131 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 132 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 134 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 133 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 131 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 134 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 124 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 132 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 123 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 122 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 133 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 121 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 136 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 138 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 135 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 136 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 137 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 135 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 138 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 137 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 120 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 117 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 118 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 119 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 141 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 139 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 141 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 139 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 140 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 115 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 116 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 140 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 145 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 142 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 144 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 143 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 114 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 144 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 142 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 113 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 145 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 112 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 143 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 148 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 111 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 146 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 147 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 146 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 110 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 109 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 148 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 108 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 147 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 107 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 149 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 150 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 151 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 152 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 151 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 106 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 149 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 105 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 152 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 150 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 104 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 103 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 153 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 156 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 155 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 153 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 154 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 154 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 155 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 156 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 101 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 100 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 102 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 99 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 157 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 160 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 161 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 160 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 159 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 98 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 158 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 158 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 159 of cache opt-cache 14:54:28,151 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 157 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 97 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 95 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 161 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 94 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 96 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 162 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 164 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 163 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 165 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 164 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 162 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 93 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 165 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 163 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 92 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 91 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 166 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 168 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 90 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 168 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 166 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 89 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 167 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 88 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 167 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 169 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 170 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 169 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 87 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 170 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 86 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 85 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 171 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 172 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 173 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 175 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 173 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 174 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 84 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 172 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 171 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 82 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 174 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 81 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 83 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 175 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 80 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 177 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 179 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 177 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 180 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 79 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 176 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 178 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 178 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 179 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 78 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 77 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 176 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 180 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 76 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 75 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 181 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 182 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 183 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 181 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 185 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 74 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 183 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 182 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 73 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 184 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 184 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 72 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 185 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 71 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 70 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 190 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 187 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 190 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 189 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 69 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 186 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 186 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 68 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 189 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 187 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 188 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 191 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 67 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 191 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 66 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 65 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 193 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 188 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 193 of cache opt-cache 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 192 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 64 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 63 14:54:28,152 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 192 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 62 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 194 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 197 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 195 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 197 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 61 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 194 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 199 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 195 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 60 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 59 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 198 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 199 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 196 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 58 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 201 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 196 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 201 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 57 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 198 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 56 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 55 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 200 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 200 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 202 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 203 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 54 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 205 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 203 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 202 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 205 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 52 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 204 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 204 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 53 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 51 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 50 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 206 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 207 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 208 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 207 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 209 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 208 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 206 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 209 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 47 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 49 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 48 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 46 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 210 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 212 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 214 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 212 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 211 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 45 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 210 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 213 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 44 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 214 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 211 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 43 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 213 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 42 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 216 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 215 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 216 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 217 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 40 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 41 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 215 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 39 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 217 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 38 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 219 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 221 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 218 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 221 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 222 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 37 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 219 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 220 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 218 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 35 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 222 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 220 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 34 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 36 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 225 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 225 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 224 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 32 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 223 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 227 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 226 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 226 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 224 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 33 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 31 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 223 of cache opt-cache 14:54:28,153 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 227 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 30 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 29 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 28 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 229 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 231 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 228 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 232 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 231 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 229 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 230 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 27 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 232 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 228 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 230 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 24 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 26 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 25 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 23 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 233 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 236 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 235 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 235 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 22 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 233 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 236 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 21 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 234 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 20 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 234 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 19 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 238 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 239 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 238 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 237 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 18 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 240 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 240 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 237 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 239 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 16 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 17 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 15 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 244 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 243 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 241 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 243 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 242 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 14 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 244 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 13 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 242 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 241 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 245 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 246 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 247 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 12 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 247 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 246 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 10 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 11 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 248 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 248 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 8 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 9 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 250 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 249 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 245 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 250 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 7 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 249 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 6 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 5 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Applying new state chunk for segment 254 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 253 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Finished applying chunk of segment 254 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 251 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Latch 4 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 253 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 251 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 255 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 2 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 3 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 252 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 252 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 255 of cache opt-cache 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 1 14:54:28,154 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished receiving state for segments {0-255} 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Inbound transfer finished: InboundTransferTask{segments={0-255}, finishedSegments={0-255}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@49c2f2cb[Completed normally], topologyId=2, timeout=240000, cacheName=opt-cache} 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Removing inbound transfers from node {0-255} for segments test-NodeA-55522 14:54:28,154 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished receiving of segments for cache opt-cache for topology 2. 14:54:28,154 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Stop keeping track of changed keys for state transfer in topology 2 14:54:28,154 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,154 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t1) Tracking is disabled. Clear tracker: {} 14:54:28,154 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,154 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 --> DATA(test-NodeA-55522: #30, conn_id=0) 14:54:28,154 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,155 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 0 14:54:28,155 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,155 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Segments not received yet for cache opt-cache: {} 14:54:28,155 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 8 to test-NodeA-55522: null 14:54:28,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,155 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #31, conn_id=0) 14:54:28,155 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,155 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #30, conn_id=0) 14:54:28,155 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#30 14:54:28,155 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=2, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,155 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=2, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,155 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,155 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #31, conn_id=0) 14:54:28,155 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 2 14:54:28,155 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#31 14:54:28,155 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received response for request 8 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,155 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 2 14:54:28,155 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 2@opt-cache received confirmation for test-NodeB-18592, remaining list is [] 14:54:28,155 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000336: Finished cluster-wide rebalance for cache opt-cache, topology id = 2 14:54:28,155 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, members = [test-NodeA-55522, test-NodeB-18592], joiners = [test-NodeB-18592] 14:54:28,155 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,155 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,155 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 3@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592] 14:54:28,155 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, availability mode = AVAILABLE 14:54:28,155 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-8,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=13, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=17, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=22, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=27, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=51, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=56, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=61, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=67, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=68, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=69, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=70, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=74, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=93, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=94, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=95, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=102, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=103, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=118, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=119, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=148, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=149, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=150, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=151, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=160, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=161, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=172, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=176, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=190, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=194, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=207, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=208, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=211, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=214, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=215, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=235, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=236, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=251, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=2, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,155 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,155 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,155 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#24 14:54:28,155 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t3) Completed outbound transfer to node test-NodeB-18592, segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 14:54:28,155 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=24], TP: [cluster_name=ISPN] 14:54:28,155 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Updating local topology for cache opt-cache: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,155 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t3) Removing completed outbound transfer of segments to test-NodeB-18592 for cache opt-cache, segments [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195, 196, 197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226, 227, 228, 229, 230, 231, 232, 233, 234, 235, 236, 237, 238, 239, 240, 241, 242, 243, 244, 245, 246, 247, 248, 249, 250, 251, 252, 253, 254, 255] 14:54:28,155 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 5366 credits, 1911753 remaining 14:54:28,155 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,155 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=24], TP: [cluster_name=ISPN] 14:54:28,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=24], TP: [cluster_name=ISPN] 14:54:28,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=24], TP: [cluster_name=ISPN] 14:54:28,155 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#24 14:54:28,155 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#24 14:54:28,155 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} test-NodeB-18592 primary: {}, backup: {0-255} 14:54:28,156 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#24 14:54:28,155 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#24 14:54:28,156 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#24 14:54:28,156 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#24 14:54:28,156 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t2) Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,156 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,156 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,156 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,156 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,156 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeC-p146-t5) Ignoring consistent hash update 3 for cache opt-cache that doesn't exist locally 14:54:28,156 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,156 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,156 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,156 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,156 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring consistent hash update 3 for cache opt-cache that doesn't exist locally 14:54:28,156 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t3) Updating local topology for cache opt-cache: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,156 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,156 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,156 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,156 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t2) (isRunning=true) Installed new topology 3: CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,156 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling topology 3 is installed 14:54:28,156 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,156 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,156 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Topology update processed, stateTransferTopologyId = 2, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} 14:54:28,156 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Stop keeping track of changed keys for state transfer in topology 2 14:54:28,156 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,156 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,156 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,156 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,156 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 5366 credits, 1934433 remaining 14:54:28,156 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t2) Tracking is disabled. Clear tracker: {} 14:54:28,156 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} test-NodeB-18592 primary: {}, backup: {0-255} 14:54:28,156 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeB-18592: #31) 14:54:28,156 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=31, ts=6, TP: [cluster_name=ISPN] 14:54:28,156 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 5366 credits, 1911753 remaining 14:54:28,156 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 5366 credits, 1960567 remaining 14:54:28,156 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t3) Installing new cache topology CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,156 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@4b9c7f08 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, newTopologyId=3} 14:54:28,156 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=31, ts=6, TP: [cluster_name=ISPN] 14:54:28,156 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,156 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t2) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} with new topology 3 and was pre false 14:54:28,156 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeA-55522: #31, conn-id=0, ts=6) 14:54:28,156 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t2) No change listeners present! 14:54:28,157 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,157 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, newTopologyId=3} 14:54:28,157 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,157 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Unlock State Transfer in Progress for topology ID 3 14:54:28,157 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling transaction data received for topology 3 14:54:28,157 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,157 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t3) (isRunning=true) Installed new topology 3: CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,157 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,157 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling topology 3 is installed 14:54:28,157 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,157 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,157 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 3 14:54:28,157 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,157 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,157 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Topology changed, recalculating minTopologyId 14:54:28,157 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Changing minimum topology ID from 2 to 3 14:54:28,157 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Topology update processed, stateTransferTopologyId = 2, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} 14:54:28,157 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t6) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 3 14:54:28,157 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Stop keeping track of changed keys for state transfer in topology 2 14:54:28,157 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t6) Rebalance confirmation collector 3@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592] 14:54:28,157 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,157 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,157 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t3) Tracking is disabled. Clear tracker: {} 14:54:28,157 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) Check if topology CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,157 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) On stable topology update. Pending txs: 0 14:54:28,157 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@634a99a1 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, newTopologyId=3} 14:54:28,157 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t3) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} with new topology 3 and was pre false 14:54:28,157 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t3) No change listeners present! 14:54:28,157 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, newTopologyId=3} 14:54:28,157 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Unlock State Transfer in Progress for topology ID 3 14:54:28,157 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling transaction data received for topology 3 14:54:28,157 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,157 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,157 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,157 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #32, conn_id=0) 14:54:28,157 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:28,157 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:28,157 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,157 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #32, conn_id=0) 14:54:28,157 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Topology changed, recalculating minTopologyId 14:54:28,157 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#32 14:54:28,158 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Changing minimum topology ID from 2 to 3 14:54:28,158 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=3, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,158 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=3, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,158 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, unionConsistentHash=null, newTopologyId=3} 14:54:28,158 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 3 14:54:28,158 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,158 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) Check if topology CacheTopology{id=3, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,158 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 3 14:54:28,158 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) On stable topology update. Pending txs: 0 14:54:28,158 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 3@opt-cache received confirmation for test-NodeB-18592, remaining list is [] 14:54:28,158 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, members = [test-NodeA-55522, test-NodeB-18592], joiners = [test-NodeB-18592] 14:54:28,158 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,158 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,158 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 4@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592] 14:54:28,158 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, availability mode = AVAILABLE 14:54:28,158 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,158 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,158 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#25 14:54:28,158 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,158 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=25], TP: [cluster_name=ISPN] 14:54:28,158 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,158 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 5366 credits, 1906387 remaining 14:54:28,158 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=25], TP: [cluster_name=ISPN] 14:54:28,158 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,158 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=25], TP: [cluster_name=ISPN] 14:54:28,158 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=25], TP: [cluster_name=ISPN] 14:54:28,158 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#25 14:54:28,158 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#25 14:54:28,158 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#25 14:54:28,158 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#25 14:54:28,158 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,158 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#25 14:54:28,158 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#25 14:54:28,158 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,158 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,158 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,158 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,158 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,158 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,158 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring consistent hash update 4 for cache opt-cache that doesn't exist locally 14:54:28,158 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,158 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,158 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,158 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeC-p146-t5) Ignoring consistent hash update 4 for cache opt-cache that doesn't exist locally 14:54:28,159 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 5366 credits, 1929067 remaining 14:54:28,158 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,159 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 5366 credits, 1955201 remaining 14:54:28,159 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,159 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,159 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t4) Updating local topology for cache opt-cache: CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=4, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,159 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 5366 credits, 1906387 remaining 14:54:28,159 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0-255}, backup: {} 14:54:28,159 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 4: CacheTopology{id=4, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 4 is installed 14:54:28,159 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,159 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 4 14:54:28,159 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t4) Installing new cache topology CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,159 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,159 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,159 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,159 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,159 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,159 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 4 14:54:28,159 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:28,159 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,159 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Changing minimum topology ID from 3 to 4 14:54:28,159 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 4 14:54:28,159 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t5) Rebalance confirmation collector 4@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592] 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=4, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,159 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,159 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t4) (isRunning=true) Installed new topology 4: CacheTopology{id=4, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,159 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=4, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling topology 4 is installed 14:54:28,159 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) On stable topology update. Pending txs: 0 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} 14:54:28,159 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling transaction data received for topology 4 14:54:28,159 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,159 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,159 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,159 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #33, conn_id=0) 14:54:28,159 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:28,160 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,160 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:28,160 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Topology changed, recalculating minTopologyId 14:54:28,160 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Changing minimum topology ID from 3 to 4 14:54:28,160 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #33, conn_id=0) 14:54:28,160 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#33 14:54:28,160 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 256+0, test-NodeB-18592: 0+256]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=4} 14:54:28,160 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=4, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,160 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) Check if topology CacheTopology{id=4, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,160 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=4, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,160 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) On stable topology update. Pending txs: 0 14:54:28,160 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,160 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 4 14:54:28,160 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 4 14:54:28,160 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 4@opt-cache received confirmation for test-NodeB-18592, remaining list is [] 14:54:28,160 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, members = [test-NodeA-55522, test-NodeB-18592], joiners = [] 14:54:28,160 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,160 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, availability mode = AVAILABLE 14:54:28,160 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,160 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,160 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating local topology for cache opt-cache: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,160 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#26 14:54:28,160 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=26], TP: [cluster_name=ISPN] 14:54:28,160 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,160 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t3) Installing new cache topology CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,160 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3274 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=26], TP: [cluster_name=ISPN] 14:54:28,160 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,160 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#26 14:54:28,160 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#26 14:54:28,160 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,160 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,160 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,160 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t3) (isRunning=true) Installed new topology 5: CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,160 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 3274 credits, 1903113 remaining 14:54:28,160 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=3274 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=26], TP: [cluster_name=ISPN] 14:54:28,160 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling topology 5 is installed 14:54:28,160 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,160 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3274 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=26], TP: [cluster_name=ISPN] 14:54:28,160 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Updating stable topology for cache opt-cache: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,160 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#26 14:54:28,160 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#26 14:54:28,161 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache opt-cache: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,160 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,160 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#26 14:54:28,161 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#26 14:54:28,161 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,161 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,161 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,161 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 3274 credits, 1903113 remaining 14:54:28,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#27 14:54:28,161 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,161 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,161 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,161 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,161 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeC-p146-t5) Ignoring consistent hash update 5 for cache opt-cache that doesn't exist locally 14:54:28,161 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,161 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=27], TP: [cluster_name=ISPN] 14:54:28,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,161 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,161 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,161 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3274 credits, 1951927 remaining 14:54:28,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3272 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=27], TP: [cluster_name=ISPN] 14:54:28,161 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,161 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring consistent hash update 5 for cache opt-cache that doesn't exist locally 14:54:28,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3272 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=27], TP: [cluster_name=ISPN] 14:54:28,161 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 3272 credits, 1899841 remaining 14:54:28,161 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,161 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling transaction data received for topology 5 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#27 14:54:28,161 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 3274 credits, 1925793 remaining 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#27 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#27 14:54:28,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=3272 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=27], TP: [cluster_name=ISPN] 14:54:28,161 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,161 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#27 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#27 14:54:28,161 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#27 14:54:28,161 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,161 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 5: CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,161 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 5 is installed 14:54:28,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,161 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,161 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,161 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,161 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 3272 credits, 1899841 remaining 14:54:28,161 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,161 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:28,161 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,161 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,161 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Removing no longer owned entries for cache opt-cache 14:54:28,161 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,161 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3272 credits, 1948655 remaining 14:54:28,162 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 5 14:54:28,162 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,162 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,162 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 3272 credits, 1922521 remaining 14:54:28,162 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,162 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,162 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Topology changed, recalculating minTopologyId 14:54:28,162 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Changing minimum topology ID from 4 to 5 14:54:28,162 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Removing no longer owned entries for cache opt-cache 14:54:28,162 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,162 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,162 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Topology changed, recalculating minTopologyId 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,162 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Changing minimum topology ID from 4 to 5 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) On stable topology update. Pending txs: 0 14:54:28,162 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,162 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating stable topology for cache opt-cache: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,162 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Initial state transfer complete for cache opt-cache on node test-NodeB-18592 14:54:28,162 DEBUG [org.infinispan.cache.impl.CacheImpl] (TestNG) Started cache opt-cache on test-NodeB-18592 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,162 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) Cache opt-cache started 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4]} 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) On stable topology update. Pending txs: 0 14:54:28,162 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) About to wire and start cache opt-cache 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) On stable topology update. Pending txs: 0 14:54:28,162 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating stable topology for cache opt-cache: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,162 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) On stable topology update. Pending txs: 0 14:54:28,164 TRACE [org.infinispan.factories.InterceptorChainFactory] (TestNG) Finished building default interceptor chain. 14:54:28,164 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (TestNG) starting distribution manager on test-NodeC-10992 14:54:28,165 DEBUG [org.infinispan.commons.util.ServiceFinder] (TestNG) No service impls found: FilterIndexingServiceProvider 14:54:28,165 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@1f7ebb4 for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,165 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@3924483e for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,165 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain size: 12 14:54:28,165 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@36798f34 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@46f715b6 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@78e3ec97 >> org.infinispan.statetransfer.StateTransferInterceptor@631d3e0d >> org.infinispan.statetransfer.TransactionSynchronizerInterceptor@19e70d75 >> org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor@67c3f15a >> org.infinispan.interceptors.impl.TxInterceptor@232e61 >> org.infinispan.interceptors.locking.OptimisticLockingInterceptor@ac4953e >> org.infinispan.interceptors.impl.NotificationInterceptor@2b69bdb6 >> org.infinispan.interceptors.impl.VersionedEntryWrappingInterceptor@5358d0a0 >> org.infinispan.interceptors.distribution.VersionedDistributionInterceptor@4a11ac8c >> org.infinispan.interceptors.impl.CallInterceptor@6452ad95 14:54:28,165 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@2b028a4 for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,165 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@17f82582 for interface org.infinispan.notifications.cachelistener.annotation.PartitionStatusChanged 14:54:28,165 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) Starting DefaultConflictManager. isRunning=false 14:54:28,165 TRACE [org.infinispan.transaction.xa.TransactionFactory] (TestNG) Setting factory enum to NODLD_NORECOVERY_XA 14:54:28,165 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@504a8e3d for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,165 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@2185bfa4 for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,166 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@22f35638 for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute staleStatsThreshold [r=true,w=true,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute storeWrites [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute invalidations [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute currentNumberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationCount [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute sitesView [r=true,w=false,is=false,type=java.lang.String] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 14:54:28,166 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationFailures [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void setStatisticsEnabled 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute commits [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute prepares [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rollbacks [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute elapsedTime [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isAffectedByRehash 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation java.util.List locateKey 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isLocatedLocally 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void disconnectSource 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void recordKnownGlobalKeyset 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,167 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictionSize [r=true,w=true,is=false,type=long] 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@3c1d13b5 under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@694b90b2 under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@33deb4ef under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@3c17c33c under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RpcManager 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@6843efb0 under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Passivation 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@5db82c0a under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Transactions 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@1b87929e under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=LockManager 14:54:28,167 DEBUG [org.infinispan.jmx.JmxUtil] (TestNG) Object name infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@198bbcf1 under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Statistics 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@6ec2ee1f under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Activation 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@728647b1 under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@55b2281d under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 14:54:28,167 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@119a6a6e under infinispan-d5431d0b-fd7d-4940-b76a-0fa20d7e6368:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Configuration 14:54:28,167 TRACE [org.infinispan.jmx.CacheJmxRegistration] (TestNG) ISPN000031: MBeans were successfully registered to the platform MBean server. 14:54:28,167 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Starting StateTransferManager of cache opt-cache on node test-NodeC-10992 14:54:28,167 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Node test-NodeC-10992 joining cache opt-cache 14:54:28,168 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeC-10992 sending request 9 to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeC-10992, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a4bb04c4-2aa5-469c-b481-a543584bde06, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,168 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeC-10992 --> DATA(test-NodeA-55522: #18, conn_id=0) 14:54:28,168 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 14:54:28,168 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=94 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 14:54:28,168 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #18, conn_id=0) 14:54:28,168 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#18 14:54:28,168 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 9 from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeC-10992, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a4bb04c4-2aa5-469c-b481-a543584bde06, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,168 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeC-10992, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a4bb04c4-2aa5-469c-b481-a543584bde06, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeC-10992] 14:54:28,168 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,168 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Added joiner test-NodeC-10992 to cache opt-cache with persistent uuid a4bb04c4-2aa5-469c-b481-a543584bde06: members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], joiners = [test-NodeC-10992] 14:54:28,168 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Queueing rebalance for cache opt-cache with members [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:28,168 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Rebalancing consistent hash for cache opt-cache, members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:28,168 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Updating cache opt-cache topology for rebalance: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,168 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], joiners = [test-NodeC-10992] 14:54:28,168 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,168 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,168 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 6@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:28,169 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000310: Starting cluster-wide rebalance for cache opt-cache, topology CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,169 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100002: Started rebalance with topology id 6 14:54:28,169 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,169 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,169 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#28 14:54:28,169 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Updating local topology for cache opt-cache: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,169 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=28], TP: [cluster_name=ISPN] 14:54:28,169 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,169 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,169 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,169 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6475 credits, 1893366 remaining 14:54:28,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6475 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=28], TP: [cluster_name=ISPN] 14:54:28,169 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#28 14:54:28,169 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#28 14:54:28,169 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 9 to test-NodeC-10992: SuccessfulResponse(StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, stableTopology=CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}}) 14:54:28,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=6475 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=28], TP: [cluster_name=ISPN] 14:54:28,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6475 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=28], TP: [cluster_name=ISPN] 14:54:28,169 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#28 14:54:28,169 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#28 14:54:28,169 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeC-10992: #8, conn_id=1) 14:54:28,169 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,169 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,169 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,169 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,169 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 6475 credits, 1916046 remaining 14:54:28,169 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t5) Installing new cache topology CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,169 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,169 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,169 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,169 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#28 14:54:28,169 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#28 14:54:28,169 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache opt-cache: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,169 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,169 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,169 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,169 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=6422 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,169 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,170 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,169 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 6475 credits, 1893366 remaining 14:54:28,170 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,170 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #8, conn_id=1) 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,170 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 6475 credits, 1942180 remaining 14:54:28,170 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,170 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring rebalance 6 for cache opt-cache that doesn't exist locally 14:54:28,170 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#8 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=6} 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,170 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 9 from test-NodeA-55522: SuccessfulResponse(StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}, stableTopology=CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]}}) 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,170 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t5) (isRunning=true) Installed new topology 6: CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,170 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating local topology for cache opt-cache: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Start keeping track of keys for rebalance 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=6} 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Tracking is disabled. Clear tracker: {} 14:54:28,170 TRACE [org.infinispan.topology.CacheTopology] (TestNG) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,170 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 6: CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Installing new cache topology CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} on cache opt-cache 14:54:28,170 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling topology 6 is installed 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Start keeping track of keys for rebalance 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Tracking is disabled. Clear tracker: {} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Received new topology for cache opt-cache, isRebalance = false, isMember = false, topology = CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 6 is installed 14:54:28,170 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) (isRunning=true) Installed new topology 5: CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Topology update processed, stateTransferTopologyId = 6, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling topology 5 is installed 14:54:28,170 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling transaction data received for topology 6 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Requesting cluster listeners of cache opt-cache from node test-NodeA-55522 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,170 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Finished receiving of segments for cache opt-cache for topology 6. 14:54:28,170 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Stop keeping track of changed keys for state transfer in topology 6 14:54:28,170 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeC-10992 sending request 10 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,170 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeC-10992 --> DATA(test-NodeA-55522: #19, conn_id=0) 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Tracking is disabled. Clear tracker: {} 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = 6, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,170 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,170 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 14:54:28,170 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 6 14:54:28,170 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,170 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Finished receiving of segments for cache opt-cache for topology 6. 14:54:28,170 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Stop keeping track of changed keys for state transfer in topology 6 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,170 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Tracking is disabled. Clear tracker: {} 14:54:28,170 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,170 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,170 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,171 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,171 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Topology changed, recalculating minTopologyId 14:54:28,171 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=20 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 14:54:28,171 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 6 14:54:28,171 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Changing minimum topology ID from 5 to 6 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #19, conn_id=0) 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#19 14:54:28,171 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 6 14:54:28,171 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,171 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 10 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=null, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} 14:54:28,171 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,171 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t1) Rebalance confirmation collector 6@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeC-10992] 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #34, conn_id=0) 14:54:28,171 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} [sender=test-NodeC-10992] 14:54:28,171 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:28,171 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,171 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} 14:54:28,171 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) Check if topology CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,171 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-thread-test-NodeA-p130-t6) Request received to get cluster listeners currently registered 14:54:28,171 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-thread-test-NodeA-p130-t6) Cluster listeners found [] 14:54:28,171 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:28,171 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 10 to test-NodeC-10992: SuccessfulResponse([]) 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeC-10992: #9, conn_id=1) 14:54:28,171 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,171 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) On stable topology update. Pending txs: 0 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #34, conn_id=0) 14:54:28,171 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,171 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#34 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #9, conn_id=1) 14:54:28,171 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Topology changed, recalculating minTopologyId 14:54:28,171 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=6, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,171 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#9 14:54:28,171 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Changing minimum topology ID from 5 to 6 14:54:28,171 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=6, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,171 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 10 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,171 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,171 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 6 14:54:28,171 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-10,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_CACHE_LISTENERS, topologyId=5, segments=null} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,171 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,171 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) On cache opt-cache we have: added segments: [] 14:54:28,171 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 6 14:54:28,171 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,171 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 6@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeC-10992] 14:54:28,171 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling transaction data received for topology 5 14:54:28,171 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,171 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,171 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) On stable topology update. Pending txs: 0 14:54:28,171 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,171 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,171 DEBUG [org.infinispan.transaction.impl.TransactionTable] (TestNG) Topology changed, recalculating minTopologyId 14:54:28,171 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Changing minimum topology ID from -1 to 5 14:54:28,171 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionConsistentHash=null, newTopologyId=5} 14:54:28,171 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=5, rebalanceId=2, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is null 14:54:28,172 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating stable topology for cache opt-cache: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,172 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,172 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) On stable topology update. Pending txs: 0 14:54:28,172 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) StateTransferManager of cache opt-cache on node test-NodeC-10992 received initial topology CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,172 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeC-10992 sending request 11 to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=test-NodeC-10992, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,172 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeC-10992 --> DATA(test-NodeA-55522: #20, conn_id=0) 14:54:28,172 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Updating local topology for cache opt-cache: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,172 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 14:54:28,172 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,172 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,172 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=20 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 14:54:28,172 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #20, conn_id=0) 14:54:28,172 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,172 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#20 14:54:28,172 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 11 from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:28,172 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeC-10992] 14:54:28,172 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,172 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t3) Installing new cache topology CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,172 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 11 to test-NodeC-10992: SuccessfulResponse(true) 14:54:28,172 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t3) This is the first topology 6 in which the local node is a member 14:54:28,172 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeC-10992: #10, conn_id=1) 14:54:28,172 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,172 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,172 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,172 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,172 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,172 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #10, conn_id=1) 14:54:28,172 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#10 14:54:28,172 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 11 from test-NodeA-55522: SuccessfulResponse(true) 14:54:28,173 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t3) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@2eec5549 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=6} 14:54:28,173 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Waiting for initial state transfer to finish for cache opt-cache on test-NodeC-10992 14:54:28,173 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t3) (isRunning=true) Installed new topology 6: CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,173 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Start keeping track of keys for rebalance 14:54:28,173 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,173 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t3) Tracking is disabled. Clear tracker: {} 14:54:28,173 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t3) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,173 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t3) Signalling topology 6 is installed 14:54:28,173 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) On cache opt-cache we have: new segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; old segments: [] 14:54:28,173 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) On cache opt-cache we have: added segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; removed segments: {} 14:54:28,173 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Adding inbound state transfer for segments {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,173 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Requesting transactions from node test-NodeA-55522 for segments {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} 14:54:28,173 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,173 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 sending request 12 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} 14:54:28,173 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 --> DATA(test-NodeA-55522: #21, conn_id=0) 14:54:28,173 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 14:54:28,173 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=564 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 14:54:28,173 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #21, conn_id=0) 14:54:28,173 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#21 14:54:28,174 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 12 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} 14:54:28,174 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} [sender=test-NodeC-10992] 14:54:28,174 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,174 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} 14:54:28,174 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Received request for transactions from node test-NodeC-10992 for cache opt-cache, topology id 6, segments {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} 14:54:28,174 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Found 0 transaction(s) to transfer 14:54:28,174 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 12 to test-NodeC-10992: SuccessfulResponse([]) 14:54:28,174 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeC-10992: #11, conn_id=1) 14:54:28,174 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,174 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,174 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #11, conn_id=1) 14:54:28,174 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#11 14:54:28,174 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 12 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,174 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-10,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,174 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:28,174 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Requesting transactions from node test-NodeB-18592 for segments {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} 14:54:28,174 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,174 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 sending request 13 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} 14:54:28,174 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 --> DATA(test-NodeB-18592: #5, conn_id=1) 14:54:28,174 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,174 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=546 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,174 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #5, conn_id=1) 14:54:28,174 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#5 14:54:28,174 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 13 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} 14:54:28,174 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} [sender=test-NodeC-10992] 14:54:28,175 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,175 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} 14:54:28,175 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Received request for transactions from node test-NodeC-10992 for cache opt-cache, topology id 6, segments {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} 14:54:28,175 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Found 0 transaction(s) to transfer 14:54:28,175 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 13 to test-NodeC-10992: SuccessfulResponse([]) 14:54:28,175 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeC-10992: #5, conn_id=1) 14:54:28,175 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,175 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,175 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #5, conn_id=1) 14:54:28,175 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#5 14:54:28,175 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 13 from test-NodeB-18592: SuccessfulResponse([]) 14:54:28,175 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-10,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} is {test-NodeB-18592=SuccessfulResponse([])} 14:54:28,175 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Applying 0 transactions for cache opt-cache transferred from node test-NodeB-18592 14:54:28,175 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Adding transfer from test-NodeA-55522 for segments {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} 14:54:28,175 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Adding transfer from test-NodeB-18592 for segments {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} 14:54:28,175 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t3) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} 14:54:28,175 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Finished adding inbound state transfer for segments {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,175 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,175 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Topology update processed, stateTransferTopologyId = 6, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,175 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t3) Signalling transaction data received for topology 6 14:54:28,175 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992 sending request 14 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} 14:54:28,175 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,175 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992 --> DATA(test-NodeA-55522: #22, conn_id=0) 14:54:28,175 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,175 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 14:54:28,175 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,175 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t3) Topology changed, recalculating minTopologyId 14:54:28,175 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t3) Changing minimum topology ID from 5 to 6 14:54:28,175 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=6} 14:54:28,175 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t3) Check if topology CacheTopology{id=6, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,175 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t3) On stable topology update. Pending txs: 0 14:54:28,177 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=564 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 14:54:28,177 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #22, conn_id=0) 14:54:28,177 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#22 14:54:28,177 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 14 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} 14:54:28,177 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} [sender=test-NodeC-10992] 14:54:28,177 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,177 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} 14:54:28,178 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Starting outbound transfer to node test-NodeC-10992 for cache opt-cache, topology id 6, segments {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} 14:54:28,178 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Adding outbound transfer to test-NodeC-10992 for segments [0, 1, 2, 3, 4, 8, 18, 34, 35, 36, 37, 39, 40, 42, 43, 44, 45, 47, 48, 49, 52, 53, 54, 55, 58, 73, 75, 79, 82, 86, 90, 91, 101, 105, 108, 110, 111, 112, 113, 114, 115, 122, 123, 124, 125, 126, 129, 132, 135, 136, 138, 139, 143, 152, 153, 154, 156, 157, 173, 174, 175, 177, 178, 187, 188, 191, 192, 193, 195, 196, 199, 200, 201, 202, 216, 217, 218, 221, 223, 227, 228, 244, 247, 250, 252, 254, 255] 14:54:28,178 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 14 to test-NodeC-10992: SuccessfulResponse(null) 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeC-10992: #12, conn_id=1) 14:54:28,178 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Sending last chunk to node test-NodeC-10992 containing 0 cache entries from segments [0, 1, 2, 3, 4, 8, 18, 34, 35, 36, 37, 39, 40, 42, 43, 44, 45, 47, 48, 49, 52, 53, 54, 55, 58, 73, 75, 79, 82, 86, 90, 91, 101, 105, 108, 110, 111, 112, 113, 114, 115, 122, 123, 124, 125, 126, 129, 132, 135, 136, 138, 139, 143, 152, 153, 154, 156, 157, 173, 174, 175, 177, 178, 187, 188, 191, 192, 193, 195, 196, 199, 200, 201, 202, 216, 217, 218, 221, 223, 227, 228, 244, 247, 250, 252, 254, 255] 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,178 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=6, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #12, conn_id=1) 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#12 14:54:28,178 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 14 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,178 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 sending request 9 to test-NodeC-10992: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=6, applyState=true} 14:54:28,178 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-10,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 --> DATA(test-NodeC-10992: #13, conn_id=1) 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeA-55522: #15) 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=15, ts=6, TP: [cluster_name=ISPN] 14:54:28,178 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t3) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} 14:54:28,178 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}, finishedSegments={}, unfinishedSegments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3583d3be[Not completed], topologyId=6, timeout=240000, cacheName=opt-cache} 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeC-10992: #5) 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=7, TP: [cluster_name=ISPN] 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=913 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #13, conn_id=1) 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#13 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=7, TP: [cluster_name=ISPN] 14:54:28,178 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeB-18592: #5, conn-id=1, ts=7) 14:54:28,178 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received request 9 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=6, applyState=true} 14:54:28,179 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=6, applyState=true} [sender=test-NodeA-55522] 14:54:28,179 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-10,test-NodeC-10992) Checking if transaction data was received for topology 6, current topology is 6 14:54:28,179 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,178 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, ts=6, TP: [cluster_name=ISPN] 14:54:28,179 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeB-18592: #15, conn-id=0, ts=6) 14:54:28,179 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=6, applyState=true} 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 2 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 1 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 2 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 1 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 86 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 85 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 3 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 4 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 3 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 0 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 84 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 4 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 0 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 83 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 82 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 35 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 8 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 18 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 8 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 34 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 35 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 81 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 80 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 34 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 18 of cache opt-cache 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 79 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 78 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 36 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 39 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,179 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 37 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 39 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 36 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 37 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 77 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 76 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 43 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 75 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 43 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 40 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 74 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 45 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 40 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 44 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 73 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 45 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 72 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 42 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 42 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 71 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 44 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 48 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 47 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 49 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 48 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 70 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 49 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 47 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 68 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 69 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 53 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 52 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 54 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 53 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 67 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 66 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 54 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 52 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 65 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 64 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 75 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 55 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 73 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 75 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 58 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 73 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 55 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 62 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 58 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 63 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 61 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 60 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 82 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 90 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 79 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 82 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 86 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 79 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 86 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 90 of cache opt-cache 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 59 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 57 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 58 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 56 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 91 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 101 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,180 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 91 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 101 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 55 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 54 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 108 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 110 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 105 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 110 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 112 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 53 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 111 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 105 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 108 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 52 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 112 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 111 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 50 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 51 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 115 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 115 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 113 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 49 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 48 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 113 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 124 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 114 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 124 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 123 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 122 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 123 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 47 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 45 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 46 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 122 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 114 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 44 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 125 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 126 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 43 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 125 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 126 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 42 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 41 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 129 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 136 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 132 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 138 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 136 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 129 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 135 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 40 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 138 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 132 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 38 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 135 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 37 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 39 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 139 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 143 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 139 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 36 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 35 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 143 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 34 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 157 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 156 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 157 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 152 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 33 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 153 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 153 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 154 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 32 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 156 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 152 of cache opt-cache 14:54:28,181 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 173 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 31 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 173 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 30 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 154 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 29 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 28 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 174 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 178 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 177 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 178 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 27 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 175 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 175 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 188 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 26 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 174 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 25 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 187 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 177 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 188 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 24 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 187 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 23 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 22 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 191 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 196 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 191 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 192 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 21 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 193 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 193 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 195 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 20 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 196 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 192 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 195 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 19 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 17 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 18 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 199 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 216 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 199 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 201 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 16 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 200 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 200 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 202 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 15 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 201 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 202 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 216 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 13 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 14 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 12 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 218 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 227 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 218 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 217 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 223 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 11 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 223 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 221 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 221 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 10 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 9 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 217 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 8 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 227 of cache opt-cache 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 7 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 228 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 250 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 244 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,182 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 252 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 244 of cache opt-cache 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 250 of cache opt-cache 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 228 of cache opt-cache 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 5 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 247 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 247 of cache opt-cache 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 6 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 3 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 252 of cache opt-cache 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 4 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 2 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 254 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 255 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 254 of cache opt-cache 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 255 of cache opt-cache 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 1 14:54:28,183 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished receiving state for segments {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Inbound transfer finished: InboundTransferTask{segments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}, finishedSegments={0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3583d3be[Completed normally], topologyId=6, timeout=240000, cacheName=opt-cache} 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Removing inbound transfers from node {0-4 8 18 34-37 39-40 42-45 47-49 52-55 58 73 75 79 82 86 90-91 101 105 108 110-115 122-126 129 132 135-136 138-139 143 152-154 156-157 173-175 177-178 187-188 191-193 195-196 199-202 216-218 221 223 227-228 244 247 250 252 254-255} for segments test-NodeA-55522 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 0 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,183 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t1) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} 14:54:28,183 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Segments not received yet for cache opt-cache: {test-NodeB-18592=[InboundTransferTask{segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}, finishedSegments={}, unfinishedSegments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@2ddd006[Not completed], topologyId=6, timeout=240000, cacheName=opt-cache}]} 14:54:28,183 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,183 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 9 to test-NodeA-55522: null 14:54:28,183 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeA-55522: #23, conn_id=0) 14:54:28,183 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 14:54:28,183 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992 sending request 15 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} 14:54:28,183 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992 --> DATA(test-NodeB-18592: #6, conn_id=1) 14:54:28,183 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,183 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 14:54:28,183 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #23, conn_id=0) 14:54:28,183 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=546 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,183 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#23 14:54:28,183 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #6, conn_id=1) 14:54:28,183 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received response for request 9 from test-NodeC-10992: SuccessfulResponse(null) 14:54:28,183 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#6 14:54:28,183 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 15 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} 14:54:28,183 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} [sender=test-NodeC-10992] 14:54:28,183 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-8,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=6, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:28,183 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,183 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Completed outbound transfer to node test-NodeC-10992, segments [0, 1, 2, 3, 4, 8, 18, 34, 35, 36, 37, 39, 40, 42, 43, 44, 45, 47, 48, 49, 52, 53, 54, 55, 58, 73, 75, 79, 82, 86, 90, 91, 101, 105, 108, 110, 111, 112, 113, 114, 115, 122, 123, 124, 125, 126, 129, 132, 135, 136, 138, 139, 143, 152, 153, 154, 156, 157, 173, 174, 175, 177, 178, 187, 188, 191, 192, 193, 195, 196, 199, 200, 201, 202, 216, 217, 218, 221, 223, 227, 228, 244, 247, 250, 252, 254, 255] 14:54:28,183 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t6) Removing completed outbound transfer of segments to test-NodeC-10992 for cache opt-cache, segments [0, 1, 2, 3, 4, 8, 18, 34, 35, 36, 37, 39, 40, 42, 43, 44, 45, 47, 48, 49, 52, 53, 54, 55, 58, 73, 75, 79, 82, 86, 90, 91, 101, 105, 108, 110, 111, 112, 113, 114, 115, 122, 123, 124, 125, 126, 129, 132, 135, 136, 138, 139, 143, 152, 153, 154, 156, 157, 173, 174, 175, 177, 178, 187, 188, 191, 192, 193, 195, 196, 199, 200, 201, 202, 216, 217, 218, 221, 223, 227, 228, 244, 247, 250, 252, 254, 255] 14:54:28,183 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} 14:54:28,184 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Starting outbound transfer to node test-NodeC-10992 for cache opt-cache, topology id 6, segments {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} 14:54:28,184 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Adding outbound transfer to test-NodeC-10992 for segments [5, 6, 7, 15, 16, 19, 23, 24, 25, 26, 28, 29, 30, 31, 32, 41, 46, 50, 57, 59, 65, 66, 72, 76, 78, 80, 81, 83, 84, 85, 87, 88, 89, 92, 96, 97, 98, 99, 100, 104, 106, 107, 109, 120, 121, 127, 128, 131, 133, 134, 137, 140, 141, 142, 144, 145, 146, 162, 163, 164, 165, 166, 179, 180, 181, 182, 183, 184, 185, 186, 189, 197, 198, 203, 222, 225, 226, 229, 230, 245, 246, 248, 249, 253] 14:54:28,184 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 15 to test-NodeC-10992: SuccessfulResponse(null) 14:54:28,184 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeC-10992: #6, conn_id=1) 14:54:28,184 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t1) Sending last chunk to node test-NodeC-10992 containing 0 cache entries from segments [5, 6, 7, 15, 16, 19, 23, 24, 25, 26, 28, 29, 30, 31, 32, 41, 46, 50, 57, 59, 65, 66, 72, 76, 78, 80, 81, 83, 84, 85, 87, 88, 89, 92, 96, 97, 98, 99, 100, 104, 106, 107, 109, 120, 121, 127, 128, 131, 133, 134, 137, 140, 141, 142, 144, 145, 146, 162, 163, 164, 165, 166, 179, 180, 181, 182, 183, 184, 185, 186, 189, 197, 198, 203, 222, 225, 226, 229, 230, 245, 246, 248, 249, 253] 14:54:28,184 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,184 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=6, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,184 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,184 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #6, conn_id=1) 14:54:28,184 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#6 14:54:28,184 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 15 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,184 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-10,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=6, segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,184 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t1) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} 14:54:28,184 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 sending request 15 to test-NodeC-10992: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=6, applyState=true} 14:54:28,184 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}, finishedSegments={}, unfinishedSegments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@2ddd006[Not completed], topologyId=6, timeout=240000, cacheName=opt-cache} 14:54:28,184 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 --> DATA(test-NodeC-10992: #7, conn_id=1) 14:54:28,184 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,184 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=883 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,184 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #7, conn_id=1) 14:54:28,184 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#7 14:54:28,184 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received request 15 from test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=6, applyState=true} 14:54:28,184 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=6, applyState=true} [sender=test-NodeB-18592] 14:54:28,184 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-10,test-NodeC-10992) Checking if transaction data was received for topology 6, current topology is 6 14:54:28,184 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,184 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=6, applyState=true} 14:54:28,184 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 16 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 15 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 7 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 15 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 6 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 83 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 5 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 5 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 16 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 82 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 6 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 7 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 81 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 79 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 80 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 19 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 24 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 26 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 23 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 24 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 25 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 78 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 19 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 77 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 23 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 26 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 25 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 75 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 76 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 74 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 29 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 30 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 29 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 31 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 28 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 32 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 31 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 32 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 73 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 72 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 30 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 71 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 28 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 69 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 70 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 41 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 59 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 41 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 50 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 46 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 68 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 57 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 57 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 46 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 67 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 50 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 66 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 59 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 65 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 64 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 65 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 66 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 65 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 78 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 72 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 63 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 76 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 72 of cache opt-cache 14:54:28,185 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 78 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 62 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 76 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 66 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 60 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 61 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 59 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 81 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 84 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 85 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 84 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 80 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 80 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 81 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 57 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 83 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 85 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 58 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 83 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 56 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 55 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 54 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 87 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 92 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 87 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 88 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 53 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 89 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 89 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 52 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 88 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 92 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 51 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 50 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 96 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 100 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 96 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 98 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 97 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 49 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 99 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 99 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 97 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 98 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 48 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 46 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 100 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 45 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 47 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 104 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 106 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 106 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 44 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 109 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 104 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 107 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 109 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 107 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 43 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 42 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 41 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 120 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 131 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 120 of cache opt-cache 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 40 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 127 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 121 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 128 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 128 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 39 14:54:28,186 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 127 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 131 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 38 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 121 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 37 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 36 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 133 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 140 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 133 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 134 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 35 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 141 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 141 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 137 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 140 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 134 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 33 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 137 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 34 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 32 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 142 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 145 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 31 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 142 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 144 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 145 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 144 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 30 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 29 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 28 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 162 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 164 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 162 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 165 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 27 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 146 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 146 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 163 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 26 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 163 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 165 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 25 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 164 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 24 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 23 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 179 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 181 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 166 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 182 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 166 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 180 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 22 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 180 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 181 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 179 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 20 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 182 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 21 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 19 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 18 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 184 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 184 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 17 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 186 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 183 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 185 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 186 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 183 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 185 of cache opt-cache 14:54:28,187 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 16 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 14 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 15 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 189 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 198 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 189 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 197 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 13 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 203 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 222 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 222 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 197 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 203 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 12 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 198 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 11 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 10 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 9 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 230 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 225 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 229 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 225 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 230 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 8 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 226 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 226 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 229 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 7 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 6 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 245 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 245 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 4 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 5 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 246 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 248 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 246 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 248 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 3 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 2 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 249 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 253 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 249 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 253 of cache opt-cache 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 1 14:54:28,188 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished receiving state for segments {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Inbound transfer finished: InboundTransferTask{segments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}, finishedSegments={5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@2ddd006[Completed normally], topologyId=6, timeout=240000, cacheName=opt-cache} 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Removing inbound transfers from node {5-7 15-16 19 23-26 28-32 41 46 50 57 59 65-66 72 76 78 80-81 83-85 87-89 92 96-100 104 106-107 109 120-121 127-128 131 133-134 137 140-142 144-146 162-166 179-186 189 197-198 203 222 225-226 229-230 245-246 248-249 253} for segments test-NodeB-18592 14:54:28,188 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished receiving of segments for cache opt-cache for topology 6. 14:54:28,188 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Stop keeping track of changed keys for state transfer in topology 6 14:54:28,188 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,188 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Tracking is disabled. Clear tracker: {} 14:54:28,188 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,188 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 --> DATA(test-NodeA-55522: #24, conn_id=0) 14:54:28,188 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 14:54:28,189 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 0 14:54:28,189 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,189 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Segments not received yet for cache opt-cache: {} 14:54:28,189 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 15 to test-NodeB-18592: null 14:54:28,189 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 14:54:28,189 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeB-18592: #7, conn_id=1) 14:54:28,189 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #24, conn_id=0) 14:54:28,189 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,189 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#24 14:54:28,189 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=6, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,189 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,189 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=6, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeC-10992] 14:54:28,189 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #7, conn_id=1) 14:54:28,189 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,189 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#7 14:54:28,189 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 6 14:54:28,189 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 15 from test-NodeC-10992: SuccessfulResponse(null) 14:54:28,189 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 6 14:54:28,189 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 6@opt-cache received confirmation for test-NodeC-10992, remaining list is [] 14:54:28,189 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000336: Finished cluster-wide rebalance for cache opt-cache, topology id = 6 14:54:28,189 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=6, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:28,189 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], joiners = [test-NodeC-10992] 14:54:28,189 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t1) Completed outbound transfer to node test-NodeC-10992, segments [5, 6, 7, 15, 16, 19, 23, 24, 25, 26, 28, 29, 30, 31, 32, 41, 46, 50, 57, 59, 65, 66, 72, 76, 78, 80, 81, 83, 84, 85, 87, 88, 89, 92, 96, 97, 98, 99, 100, 104, 106, 107, 109, 120, 121, 127, 128, 131, 133, 134, 137, 140, 141, 142, 144, 145, 146, 162, 163, 164, 165, 166, 179, 180, 181, 182, 183, 184, 185, 186, 189, 197, 198, 203, 222, 225, 226, 229, 230, 245, 246, 248, 249, 253] 14:54:28,189 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t1) Removing completed outbound transfer of segments to test-NodeC-10992 for cache opt-cache, segments [5, 6, 7, 15, 16, 19, 23, 24, 25, 26, 28, 29, 30, 31, 32, 41, 46, 50, 57, 59, 65, 66, 72, 76, 78, 80, 81, 83, 84, 85, 87, 88, 89, 92, 96, 97, 98, 99, 100, 104, 106, 107, 109, 120, 121, 127, 128, 131, 133, 134, 137, 140, 141, 142, 144, 145, 146, 162, 163, 164, 165, 166, 179, 180, 181, 182, 183, 184, 185, 186, 189, 197, 198, 203, 222, 225, 226, 229, 230, 245, 246, 248, 249, 253] 14:54:28,189 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,189 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,189 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 7@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:28,189 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, availability mode = AVAILABLE 14:54:28,189 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,189 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,189 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#29 14:54:28,189 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Updating local topology for cache opt-cache: CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,189 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=29], TP: [cluster_name=ISPN] 14:54:28,189 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,189 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=29], TP: [cluster_name=ISPN] 14:54:28,189 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=29], TP: [cluster_name=ISPN] 14:54:28,189 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6476 credits, 1886890 remaining 14:54:28,190 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#29 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,189 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#29 14:54:28,190 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#29 14:54:28,190 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#29 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} test-NodeC-10992 primary: {}, backup: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,190 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,190 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=29], TP: [cluster_name=ISPN] 14:54:28,190 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,190 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t2) Installing new cache topology CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,190 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,190 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#29 14:54:28,190 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,190 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,190 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 6476 credits, 1886890 remaining 14:54:28,190 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Updating local topology for cache opt-cache: CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,190 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#29 14:54:28,190 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating local topology for cache opt-cache: CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,190 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,190 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,190 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,190 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring consistent hash update 7 for cache opt-cache that doesn't exist locally 14:54:28,190 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,190 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,190 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 6476 credits, 1935704 remaining 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,190 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 6476 credits, 1909570 remaining 14:54:28,190 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} test-NodeC-10992 primary: {}, backup: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,190 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,190 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t4) Installing new cache topology CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,190 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} test-NodeC-10992 primary: {}, backup: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,190 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,190 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t2) (isRunning=true) Installed new topology 7: CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,190 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling topology 7 is installed 14:54:28,190 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) Installing new cache topology CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,190 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,190 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,190 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Topology update processed, stateTransferTopologyId = 6, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Stop keeping track of changed keys for state transfer in topology 6 14:54:28,191 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t4) (isRunning=true) Installed new topology 7: CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,191 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,191 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t4) Signalling topology 7 is installed 14:54:28,191 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t2) Tracking is disabled. Clear tracker: {} 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) On cache opt-cache we have: new segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; old segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@4b9c7f08 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=7} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Topology update processed, stateTransferTopologyId = 6, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Stop keeping track of changed keys for state transfer in topology 6 14:54:28,191 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t2) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} with new topology 7 and was pre false 14:54:28,191 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t2) (isRunning=true) Installed new topology 7: CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,191 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,191 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t2) No change listeners present! 14:54:28,191 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling topology 7 is installed 14:54:28,191 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t4) Tracking is disabled. Clear tracker: {} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=7} 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@37794112 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=7} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Unlock State Transfer in Progress for topology ID 7 14:54:28,191 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} with new topology 7 and was pre false 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Topology update processed, stateTransferTopologyId = 6, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling transaction data received for topology 7 14:54:28,191 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t4) No change listeners present! 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Stop keeping track of changed keys for state transfer in topology 6 14:54:28,191 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,191 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,191 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@2eec5549 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=7} 14:54:28,191 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Tracking is disabled. Clear tracker: {} 14:54:28,191 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Unlock State Transfer in Progress for topology ID 7 14:54:28,191 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t4) Signalling transaction data received for topology 7 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,191 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,191 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t4) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 7 14:54:28,191 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t4) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 7 14:54:28,191 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t4) Rebalance confirmation collector 7@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeC-10992] 14:54:28,191 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@634a99a1 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=7} 14:54:28,191 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Topology changed, recalculating minTopologyId 14:54:28,191 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,191 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Changing minimum topology ID from 6 to 7 14:54:28,191 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t2) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} with new topology 7 and was pre false 14:54:28,191 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t2) No change listeners present! 14:54:28,191 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,191 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 --> DATA(test-NodeA-55522: #25, conn_id=0) 14:54:28,191 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, newTopologyId=7} 14:54:28,192 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,192 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Unlock State Transfer in Progress for topology ID 7 14:54:28,192 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) Check if topology CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,192 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling transaction data received for topology 7 14:54:28,192 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) On stable topology update. Pending txs: 0 14:54:28,192 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,192 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,192 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,192 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,192 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,192 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 --> DATA(test-NodeA-55522: #35, conn_id=0) 14:54:28,192 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Topology changed, recalculating minTopologyId 14:54:28,192 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:28,192 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #25, conn_id=0) 14:54:28,192 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Changing minimum topology ID from 6 to 7 14:54:28,192 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#25 14:54:28,192 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=7, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,192 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,192 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,192 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:28,192 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=7, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeC-10992] 14:54:28,192 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) Check if topology CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,192 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Topology changed, recalculating minTopologyId 14:54:28,192 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 7 14:54:28,192 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,192 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #35, conn_id=0) 14:54:28,192 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#35 14:54:28,192 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 7 14:54:28,192 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Changing minimum topology ID from 6 to 7 14:54:28,192 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 7@opt-cache received confirmation for test-NodeC-10992, remaining list is [test-NodeB-18592] 14:54:28,192 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) On stable topology update. Pending txs: 0 14:54:28,192 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=7, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,192 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, unionConsistentHash=null, newTopologyId=7} 14:54:28,192 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=7, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,192 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,192 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 7 14:54:28,192 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) Check if topology CacheTopology{id=7, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,192 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) On stable topology update. Pending txs: 0 14:54:28,192 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 7 14:54:28,192 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 7@opt-cache received confirmation for test-NodeB-18592, remaining list is [] 14:54:28,192 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], joiners = [test-NodeC-10992] 14:54:28,192 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,192 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,192 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 8@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:28,192 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, availability mode = AVAILABLE 14:54:28,193 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,193 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,193 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#30 14:54:28,193 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,193 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=30], TP: [cluster_name=ISPN] 14:54:28,193 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,193 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6476 credits, 1880414 remaining 14:54:28,193 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=30], TP: [cluster_name=ISPN] 14:54:28,193 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=30], TP: [cluster_name=ISPN] 14:54:28,193 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,193 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#30 14:54:28,193 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=30], TP: [cluster_name=ISPN] 14:54:28,193 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#30 14:54:28,193 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#30 14:54:28,193 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#30 14:54:28,193 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#30 14:54:28,193 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,193 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,193 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,193 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,193 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring consistent hash update 8 for cache opt-cache that doesn't exist locally 14:54:28,193 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#30 14:54:28,193 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 6476 credits, 1929228 remaining 14:54:28,193 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,193 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 15-17 19-21 23-26 28-33 36-38 40-42 45-46 48 50-51 55 57-60 62 65-67 69-70 72-74 76 78-81 83-90 92-93 96-102 104-109 111 114-116 120-121 124-129 131-134 137 139-142 144-147 149 151 154-155 157 160 162-166 168 172 174-176 178-187 189-190 193-194 196-199 203 205-206 208 210 212 215 218-220 222-223 225-227 229-230 233 236 240-243 245-251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {0-12 14 16 18-19 22 24 26-27 29 32 34-37 39-40 42-50 52-56 58-59 61 63-64 66 68 71 73 75-77 79 81-83 86 90-92 94-95 98 100-101 103 105 108-115 117-119 121-126 129-130 132 134-139 142-144 146 148 150 152-154 156-159 161 166-167 169-171 173-175 177-178 181 184 187-189 191-193 195-196 198-204 207 209 211 213-214 216-218 221-224 227-232 234-235 237-239 244-245 247 250 252-255} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,193 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,193 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,193 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,193 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,193 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t3) Updating local topology for cache opt-cache: CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,193 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating local topology for cache opt-cache: CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,193 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,193 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,193 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,193 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,193 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,193 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 15-17 19-21 23-26 28-33 36-38 40-42 45-46 48 50-51 55 57-60 62 65-67 69-70 72-74 76 78-81 83-90 92-93 96-102 104-109 111 114-116 120-121 124-129 131-134 137 139-142 144-147 149 151 154-155 157 160 162-166 168 172 174-176 178-187 189-190 193-194 196-199 203 205-206 208 210 212 215 218-220 222-223 225-227 229-230 233 236 240-243 245-251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {0-12 14 16 18-19 22 24 26-27 29 32 34-37 39-40 42-50 52-56 58-59 61 63-64 66 68 71 73 75-77 79 81-83 86 90-92 94-95 98 100-101 103 105 108-115 117-119 121-126 129-130 132 134-139 142-144 146 148 150 152-154 156-159 161 166-167 169-171 173-175 177-178 181 184 187-189 191-193 195-196 198-204 207 209 211 213-214 216-218 221-224 227-232 234-235 237-239 244-245 247 250 252-255} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,194 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 8: CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,193 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 6476 credits, 1880414 remaining 14:54:28,193 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255}, backup: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253} test-NodeB-18592 primary: {5-7 13 15-17 19-21 23-26 28-32 38 41 46 50-51 57 59-60 62 65-67 69-70 72 74 76 78 80-81 83-85 87-89 92-93 96-100 102 104 106-107 109 116 120-121 127-128 131 133-134 137 140-142 144-147 149 151 155 160 162-166 168 172 176 179-186 189-190 194 197-198 203 205-206 208 210 212 215 219-220 222 225-226 229-230 233 236 240-243 245-246 248-249 251 253}, backup: {0-4 8-12 14 18 22 27 33-37 39-40 42-45 47-49 52-56 58 61 63-64 68 71 73 75 77 79 82 86 90-91 94-95 101 103 105 108 110-115 117-119 122-126 129-130 132 135-136 138-139 143 148 150 152-154 156-159 161 167 169-171 173-175 177-178 187-188 191-193 195-196 199-202 204 207 209 211 213-214 216-218 221 223-224 227-228 231-232 234-235 237-239 244 247 250 252 254-255} 14:54:28,193 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,194 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 8 is installed 14:54:28,194 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t3) Installing new cache topology CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,194 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,194 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,194 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Union consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 15-17 19-21 23-26 28-33 36-38 40-42 45-46 48 50-51 55 57-60 62 65-67 69-70 72-74 76 78-81 83-90 92-93 96-102 104-109 111 114-116 120-121 124-129 131-134 137 139-142 144-147 149 151 154-155 157 160 162-166 168 172 174-176 178-187 189-190 193-194 196-199 203 205-206 208 210 212 215 218-220 222-223 225-227 229-230 233 236 240-243 245-251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {0-12 14 16 18-19 22 24 26-27 29 32 34-37 39-40 42-50 52-56 58-59 61 63-64 66 68 71 73 75-77 79 81-83 86 90-92 94-95 98 100-101 103 105 108-115 117-119 121-126 129-130 132 134-139 142-144 146 148 150 152-154 156-159 161 166-167 169-171 173-175 177-178 181 184 187-189 191-193 195-196 198-204 207 209 211 213-214 216-218 221-224 227-232 234-235 237-239 244-245 247 250 252-255} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,194 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,194 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t3) (isRunning=true) Installed new topology 8: CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,194 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling topology 8 is installed 14:54:28,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: new segments: {0-255}; old segments: {0-255} 14:54:28,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,194 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling transaction data received for topology 8 14:54:28,194 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,194 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,194 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,194 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #36, conn_id=0) 14:54:28,194 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:28,194 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:28,194 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,194 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Topology changed, recalculating minTopologyId 14:54:28,194 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Changing minimum topology ID from 7 to 8 14:54:28,194 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,195 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) Check if topology CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,195 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) On stable topology update. Pending txs: 0 14:54:28,194 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 6476 credits, 1903094 remaining 14:54:28,194 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #36, conn_id=0) 14:54:28,194 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t5) Installing new cache topology CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,194 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,195 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#36 14:54:28,195 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 8 14:54:28,195 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,195 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=8, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,195 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,195 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=8, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,195 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,195 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,195 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 8 14:54:28,195 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,195 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,195 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 8 14:54:28,195 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,195 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t5) (isRunning=true) Installed new topology 8: CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,195 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 8@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeA-55522, test-NodeC-10992] 14:54:28,195 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:28,195 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,195 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling topology 8 is installed 14:54:28,195 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Changing minimum topology ID from 7 to 8 14:54:28,195 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 8 14:54:28,195 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: new segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; old segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,195 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,195 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t6) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 8 14:54:28,195 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,195 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t6) Rebalance confirmation collector 8@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeC-10992] 14:54:28,195 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,195 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} 14:54:28,195 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) On stable topology update. Pending txs: 0 14:54:28,195 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling transaction data received for topology 8 14:54:28,195 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,195 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,195 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,195 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 --> DATA(test-NodeA-55522: #26, conn_id=0) 14:54:28,195 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,195 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,195 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,195 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #26, conn_id=0) 14:54:28,195 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Topology changed, recalculating minTopologyId 14:54:28,195 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#26 14:54:28,195 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Changing minimum topology ID from 7 to 8 14:54:28,196 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=8, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,196 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=8, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeC-10992] 14:54:28,196 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132, test-NodeC-10992: 0+171]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=8} 14:54:28,196 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 8 14:54:28,196 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,196 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 8 14:54:28,196 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=8, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,196 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 8@opt-cache received confirmation for test-NodeC-10992, remaining list is [] 14:54:28,196 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) On stable topology update. Pending txs: 0 14:54:28,196 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], joiners = [] 14:54:28,196 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,196 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, availability mode = AVAILABLE 14:54:28,196 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,196 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#31 14:54:28,196 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating local topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,196 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=31], TP: [cluster_name=ISPN] 14:54:28,196 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,196 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t3) Installing new cache topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,196 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 3336 credits, 1877078 remaining 14:54:28,196 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=31], TP: [cluster_name=ISPN] 14:54:28,196 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,196 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Updating stable topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#31 14:54:28,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#31 14:54:28,196 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,196 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,196 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=31], TP: [cluster_name=ISPN] 14:54:28,196 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,196 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,196 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=31], TP: [cluster_name=ISPN] 14:54:28,196 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,196 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,196 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#31 14:54:28,196 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,196 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t3) (isRunning=true) Installed new topology 9: CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,196 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling topology 9 is installed 14:54:28,196 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache opt-cache we have: new segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255}; old segments: {0-255} 14:54:28,197 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache opt-cache we have: added segments: {}; removed segments: {15-16 19 23-25 28-32 36-37 40-41 50 57-59 65-66 72-73 78-80 83-89 92 96-101 104-107 114-115 120 124-128 131-133 139-141 144-146 154 162-165 174-175 178-186 189 193 196-197 218 225-226 245-250} 14:54:28,197 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,197 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling transaction data received for topology 9 14:54:28,197 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,197 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,197 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Removing no longer owned entries for cache opt-cache 14:54:28,197 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,197 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Topology changed, recalculating minTopologyId 14:54:28,197 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Changing minimum topology ID from 8 to 9 14:54:28,197 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,197 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,197 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) On stable topology update. Pending txs: 0 14:54:28,197 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating stable topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,197 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,197 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) On stable topology update. Pending txs: 0 14:54:28,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#31 14:54:28,196 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,196 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 3336 credits, 1899758 remaining 14:54:28,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#31 14:54:28,196 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#32 14:54:28,197 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,197 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#31 14:54:28,197 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,197 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,197 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=32], TP: [cluster_name=ISPN] 14:54:28,197 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,197 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,197 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,197 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,197 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,197 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,197 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,197 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t6) Ignoring consistent hash update 9 for cache opt-cache that doesn't exist locally 14:54:28,197 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=32], TP: [cluster_name=ISPN] 14:54:28,197 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#32 14:54:28,197 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#32 14:54:28,197 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=32], TP: [cluster_name=ISPN] 14:54:28,197 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#32 14:54:28,197 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t4) Updating local topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,197 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3336 credits, 1925892 remaining 14:54:28,197 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#32 14:54:28,197 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,197 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t4) Installing new cache topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,198 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,198 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,198 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 3334 credits, 1922558 remaining 14:54:28,197 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,197 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 3334 credits, 1873744 remaining 14:54:28,197 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=32], TP: [cluster_name=ISPN] 14:54:28,197 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,197 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 3336 credits, 1877078 remaining 14:54:28,198 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#32 14:54:28,198 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,198 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,198 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#32 14:54:28,198 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 9: CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 9 is installed 14:54:28,198 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:28,198 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,198 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,198 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache opt-cache we have: new segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; old segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,198 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 9 14:54:28,198 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,198 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,198 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,198 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 3334 credits, 1873744 remaining 14:54:28,198 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,198 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Removing no longer owned entries for cache opt-cache 14:54:28,198 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,198 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 3334 credits, 1896424 remaining 14:54:28,198 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t4) (isRunning=true) Installed new topology 9: CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling topology 9 is installed 14:54:28,198 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,198 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Topology changed, recalculating minTopologyId 14:54:28,198 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Changing minimum topology ID from 8 to 9 14:54:28,198 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: new segments: {9-17 19-25 27-33 36-38 40-41 50-51 56-74 77-80 83-89 92-107 114-120 124-128 130-133 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251}; old segments: {0-255} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: added segments: {}; removed segments: {0-8 18 26 34-35 39 42-49 52-55 75-76 81-82 90-91 108-113 121-123 129 134-138 142-143 152-153 156-157 166 173 177 187-188 191-192 195 198-203 216-217 221-223 227-230 244 252-255} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,198 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,198 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling transaction data received for topology 9 14:54:28,198 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Initial state transfer complete for cache opt-cache on node test-NodeC-10992 14:54:28,198 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,198 DEBUG [org.infinispan.cache.impl.CacheImpl] (TestNG) Started cache opt-cache on test-NodeC-10992 14:54:28,198 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,198 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,198 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) Cache opt-cache started 14:54:28,198 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:28,198 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Removing no longer owned entries for cache opt-cache 14:54:28,198 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating stable topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,198 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) About to wire and start cache opt-cache 14:54:28,198 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,198 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:28,198 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,198 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Topology changed, recalculating minTopologyId 14:54:28,199 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Changing minimum topology ID from 8 to 9 14:54:28,199 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+166, test-NodeB-18592: 88+168, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,199 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:28,199 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) On stable topology update. Pending txs: 0 14:54:28,199 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t4) Updating stable topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,199 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,199 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) On stable topology update. Pending txs: 0 14:54:28,200 TRACE [org.infinispan.factories.InterceptorChainFactory] (TestNG) Finished building default interceptor chain. 14:54:28,200 TRACE [org.infinispan.distribution.impl.DistributionManagerImpl] (TestNG) starting distribution manager on test-NodeD-25447 14:54:28,200 DEBUG [org.infinispan.commons.util.ServiceFinder] (TestNG) No service impls found: FilterIndexingServiceProvider 14:54:28,200 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@6c9c82f8 for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,200 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@2e175c1f for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,200 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain size: 12 14:54:28,200 DEBUG [org.infinispan.interceptors.impl.AsyncInterceptorChainImpl] (TestNG) Interceptor chain is: >> org.infinispan.interceptors.distribution.DistributionBulkInterceptor@48c296f5 >> org.infinispan.interceptors.impl.InvocationContextInterceptor@353ca978 >> org.infinispan.interceptors.impl.CacheMgmtInterceptor@3d3f6665 >> org.infinispan.statetransfer.StateTransferInterceptor@295c2279 >> org.infinispan.statetransfer.TransactionSynchronizerInterceptor@75756c99 >> org.infinispan.partitionhandling.impl.PartitionHandlingInterceptor@25d27c26 >> org.infinispan.interceptors.impl.TxInterceptor@63982ab7 >> org.infinispan.interceptors.locking.OptimisticLockingInterceptor@2b1f9357 >> org.infinispan.interceptors.impl.NotificationInterceptor@75d02309 >> org.infinispan.interceptors.impl.VersionedEntryWrappingInterceptor@43d542d9 >> org.infinispan.interceptors.distribution.VersionedDistributionInterceptor@613a0586 >> org.infinispan.interceptors.impl.CallInterceptor@3668b7dd 14:54:28,201 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@42d41272 for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,201 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@2b7e537b for interface org.infinispan.notifications.cachelistener.annotation.PartitionStatusChanged 14:54:28,201 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) Starting DefaultConflictManager. isRunning=false 14:54:28,201 TRACE [org.infinispan.transaction.xa.TransactionFactory] (TestNG) Setting factory enum to NODLD_NORECOVERY_XA 14:54:28,201 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@1a5975a7 for interface org.infinispan.notifications.cachelistener.annotation.DataRehashed 14:54:28,201 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.impl.AbstractListenerImpl$ListenerInvocationImpl@69fcff6e for interface org.infinispan.notifications.cachemanagerlistener.annotation.ViewChanged 14:54:28,201 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Add listener invocation org.infinispan.notifications.cachelistener.CacheNotifierImpl$BaseCacheEntryListenerInvocation@b5937a1 for interface org.infinispan.notifications.cachelistener.annotation.TopologyChanged 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isAffectedByRehash 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation boolean isLocatedLocally 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation java.util.List locateKey 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute elapsedTime [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute concurrencyLevel [r=true,w=false,is=false,type=int] 14:54:28,201 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute invalidations [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hits [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stores [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute staleStatsThreshold [r=true,w=true,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute storeWrites [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceStart [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderMisses [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute offHeapMemoryUsed [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute readWriteRatio [r=true,w=false,is=false,type=double] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeMisses [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute removeHits [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute timeSinceReset [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictions [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageRemoveTime [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute hitRatio [r=true,w=false,is=false,type=double] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageWriteTime [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute currentNumberOfEntriesInMemory [r=true,w=false,is=false,type=int] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfEntries [r=true,w=false,is=false,type=int] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute misses [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReadTime [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksAvailable [r=true,w=false,is=false,type=int] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheLoaderLoads [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute numberOfLocksHeld [r=true,w=false,is=false,type=int] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheName [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute version [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute configurationAsProperties [r=true,w=false,is=false,type=java.util.Properties] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheAvailability [r=true,w=true,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute cacheStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void stop 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void shutdown 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void clear 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void start 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute passivations [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rollbacks [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute prepares [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute commits [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatio [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute sitesView [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute averageReplicationTime [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationFailures [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=true,type=boolean] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute replicationCount [r=true,w=false,is=false,type=long] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute pendingViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute successRatioFloatingPoint [r=true,w=false,is=false,type=double] 14:54:28,202 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute committedViewAsString [r=true,w=false,is=false,type=java.lang.String] 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void setStatisticsEnabled 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void disconnectSource 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void recordKnownGlobalKeyset 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation long synchronizeData 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute rebalancingStatus [r=true,w=false,is=false,type=java.lang.String] 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute stateTransferInProgress [r=true,w=false,is=true,type=boolean] 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute joinComplete [r=true,w=false,is=true,type=boolean] 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute statisticsEnabled [r=true,w=true,is=false,type=boolean] 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute activations [r=true,w=false,is=false,type=java.lang.String] 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Operation void resetStatistics 14:54:28,203 TRACE [org.infinispan.jmx.ResourceDMBean] (TestNG) Attribute evictionSize [r=true,w=true,is=false,type=long] 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@753698fb under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=DistributionManager 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@6c4607a under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Statistics 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@2cc5c4bd under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=LockManager 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@727cb63a under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=ClusterCacheStats 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@33cc19ce under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache 14:54:28,203 DEBUG [org.infinispan.jmx.JmxUtil] (TestNG) Object name infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Cache already registered 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@162e787d under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Passivation 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@14cca629 under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Transactions 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@3161fec under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RpcManager 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@50c76429 under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=RollingUpgradeManager 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@35cf13dc under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=StateTransferManager 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@44c316a2 under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Activation 14:54:28,203 TRACE [org.infinispan.jmx.JmxUtil] (TestNG) Registered org.infinispan.jmx.ResourceDMBean@771988a9 under infinispan-a01a806a-4b45-49c7-ba93-8d09fdba1316:type=Cache,name="opt-cache(dist_sync)",manager="DefaultCacheManager",component=Configuration 14:54:28,203 TRACE [org.infinispan.jmx.CacheJmxRegistration] (TestNG) ISPN000031: MBeans were successfully registered to the platform MBean server. 14:54:28,203 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Starting StateTransferManager of cache opt-cache on node test-NodeD-25447 14:54:28,203 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Node test-NodeD-25447 joining cache opt-cache 14:54:28,203 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeD-25447 sending request 8 to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeD-25447, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=2d4a49f6-ead4-4503-aaf3-1f0a60265602, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,203 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeD-25447 --> DATA(test-NodeA-55522: #13, conn_id=0) 14:54:28,203 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 14:54:28,204 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=94 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=13, TP: [cluster_name=ISPN] 14:54:28,204 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #13, conn_id=0) 14:54:28,204 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#13 14:54:28,204 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 8 from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeD-25447, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=2d4a49f6-ead4-4503-aaf3-1f0a60265602, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,204 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=JOIN, sender=test-NodeD-25447, joinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=2d4a49f6-ead4-4503-aaf3-1f0a60265602, persistentStateChecksum=Optional.empty}, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeD-25447] 14:54:28,204 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,204 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Added joiner test-NodeD-25447 to cache opt-cache with persistent uuid 2d4a49f6-ead4-4503-aaf3-1f0a60265602: members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeD-25447] 14:54:28,204 DEBUG [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Queueing rebalance for cache opt-cache with members [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:28,204 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Rebalancing consistent hash for cache opt-cache, members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:28,204 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Updating cache opt-cache topology for rebalance: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,205 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeD-25447] 14:54:28,205 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,205 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,205 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 10@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,205 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000310: Starting cluster-wide rebalance for cache opt-cache, topology CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,205 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100002: Started rebalance with topology id 10 14:54:28,205 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,205 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,205 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Updating local topology for cache opt-cache: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,205 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#33 14:54:28,205 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,205 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=33], TP: [cluster_name=ISPN] 14:54:28,205 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,205 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,205 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=6561 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=33], TP: [cluster_name=ISPN] 14:54:28,205 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#33 14:54:28,205 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6561 credits, 1867183 remaining 14:54:28,205 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6561 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=33], TP: [cluster_name=ISPN] 14:54:28,205 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t5) Installing new cache topology CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,205 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 8 to test-NodeD-25447: SuccessfulResponse(StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, stableTopology=CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}}) 14:54:28,205 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,205 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,206 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,206 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=10} 14:54:28,206 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t5) (isRunning=true) Installed new topology 10: CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,206 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Start keeping track of keys for rebalance 14:54:28,206 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,206 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Tracking is disabled. Clear tracker: {} 14:54:28,206 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,206 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling topology 10 is installed 14:54:28,206 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache opt-cache we have: new segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255}; old segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255} 14:54:28,206 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,206 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Topology update processed, stateTransferTopologyId = 10, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,206 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling transaction data received for topology 10 14:54:28,206 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Finished receiving of segments for cache opt-cache for topology 10. 14:54:28,206 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,206 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,206 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Tracking is disabled. Clear tracker: {} 14:54:28,206 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,206 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,206 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,206 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,206 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Topology changed, recalculating minTopologyId 14:54:28,206 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Changing minimum topology ID from 9 to 10 14:54:28,206 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,206 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) Check if topology CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,206 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) On stable topology update. Pending txs: 0 14:54:28,205 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6561 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=33], TP: [cluster_name=ISPN] 14:54:28,206 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 10 14:54:28,205 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #8, conn_id=2) 14:54:28,205 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#33 14:54:28,206 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,206 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#33 14:54:28,205 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#33 14:54:28,206 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,206 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=6514 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=8, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,206 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,207 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #8, conn_id=2) 14:54:28,206 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 10 14:54:28,206 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#33 14:54:28,207 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t1) Rebalance confirmation collector 10@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,207 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#8 14:54:28,207 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,207 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 6561 credits, 1889863 remaining 14:54:28,206 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,207 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating local topology for cache opt-cache: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,207 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received response for request 8 from test-NodeA-55522: SuccessfulResponse(StatusResponse{cacheJoinInfo=null, cacheTopology=CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}, stableTopology=CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]}}) 14:54:28,207 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,207 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,207 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 6561 credits, 1915997 remaining 14:54:28,207 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#33 14:54:28,207 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating local topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,207 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,207 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,207 TRACE [org.infinispan.topology.CacheTopology] (TestNG) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,207 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,207 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,207 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,207 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 6561 credits, 1867183 remaining 14:54:28,207 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Installing new cache topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,207 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,207 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,207 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,207 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Received new topology for cache opt-cache, isRebalance = false, isMember = false, topology = CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,207 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t1) Installing new cache topology CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,207 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (TestNG) (isRunning=true) Installed new topology 9: CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,207 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling topology 9 is installed 14:54:28,207 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Requesting cluster listeners of cache opt-cache from node test-NodeA-55522 14:54:28,207 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,207 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,207 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,207 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@2eec5549 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=10} 14:54:28,208 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t1) (isRunning=true) Installed new topology 10: CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Start keeping track of keys for rebalance 14:54:28,208 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,208 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Tracking is disabled. Clear tracker: {} 14:54:28,208 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,208 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling topology 10 is installed 14:54:28,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache opt-cache we have: new segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; old segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Topology update processed, stateTransferTopologyId = 10, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,208 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling transaction data received for topology 10 14:54:28,208 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Finished receiving of segments for cache opt-cache for topology 10. 14:54:28,208 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,208 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,208 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Tracking is disabled. Clear tracker: {} 14:54:28,208 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,208 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,208 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,208 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 --> DATA(test-NodeA-55522: #27, conn_id=0) 14:54:28,208 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,208 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,207 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache opt-cache: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,208 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,208 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) Topology changed, recalculating minTopologyId 14:54:28,208 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,207 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_CACHE_LISTENERS, topologyId=9, segments=null} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,208 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) Changing minimum topology ID from 9 to 10 14:54:28,208 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeD-25447 sending request 9 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_CACHE_LISTENERS, topologyId=9, segments=null} 14:54:28,208 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,208 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,208 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,208 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) Check if topology CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,209 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) On stable topology update. Pending txs: 0 14:54:28,208 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #27, conn_id=0) 14:54:28,208 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeD-25447 --> DATA(test-NodeA-55522: #14, conn_id=0) 14:54:28,209 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#27 14:54:28,209 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 14:54:28,209 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=10, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,209 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=10, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeC-10992] 14:54:28,209 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,209 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 10 14:54:28,209 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,209 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,209 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,209 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=10} 14:54:28,209 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 10: CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,209 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Start keeping track of keys for rebalance 14:54:28,209 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,209 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t5) Tracking is disabled. Clear tracker: {} 14:54:28,209 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t5) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,209 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 10 is installed 14:54:28,209 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: new segments: {9-17 19-25 27-33 36-38 40-41 50-51 53-54 56-74 77-80 83-89 92-107 114-120 124-128 130-136 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251}; old segments: {9-17 19-25 27-33 36-38 40-41 50-51 56-74 77-80 83-89 92-107 114-120 124-128 130-133 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251} 14:54:28,209 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: added segments: {53-54 134-136}; removed segments: {} 14:54:28,209 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Adding inbound state transfer for segments {53-54 134-136} 14:54:28,209 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Requesting transactions from node test-NodeA-55522 for segments {53-54 135-136} 14:54:28,209 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={53-54 135-136}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,209 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 sending request 16 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={53-54 135-136}} 14:54:28,209 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 --> DATA(test-NodeA-55522: #37, conn_id=0) 14:54:28,210 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:28,210 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=65 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:28,210 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #37, conn_id=0) 14:54:28,209 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,209 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 10 14:54:28,210 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#37 14:54:28,210 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 10@opt-cache received confirmation for test-NodeC-10992, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:28,210 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 16 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={53-54 135-136}} 14:54:28,210 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={53-54 135-136}} [sender=test-NodeB-18592] 14:54:28,210 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,210 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={53-54 135-136}} 14:54:28,210 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Received request for transactions from node test-NodeB-18592 for cache opt-cache, topology id 10, segments {53-54 135-136} 14:54:28,210 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Found 0 transaction(s) to transfer 14:54:28,210 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 16 to test-NodeB-18592: SuccessfulResponse([]) 14:54:28,210 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #16, conn_id=0) 14:54:28,210 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 14:54:28,210 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 14:54:28,210 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #16, conn_id=0) 14:54:28,210 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#16 14:54:28,210 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received response for request 16 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,210 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-9,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={53-54 135-136}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,210 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:28,219 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Requesting transactions from node test-NodeC-10992 for segments {134} 14:54:28,220 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={134}} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,219 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=20 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=14, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #14, conn_id=0) 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 sending request 17 to test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={134}} 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#14 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 --> DATA(test-NodeC-10992: #8, conn_id=1) 14:54:28,220 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received request 9 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=null, type=GET_CACHE_LISTENERS, topologyId=9, segments=null} 14:54:28,220 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_CACHE_LISTENERS, topologyId=9, segments=null} [sender=test-NodeD-25447] 14:54:28,220 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,220 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_CACHE_LISTENERS, topologyId=9, segments=null} 14:54:28,220 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-thread-test-NodeA-p130-t6) Request received to get cluster listeners currently registered 14:54:28,220 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (remote-thread-test-NodeA-p130-t6) Cluster listeners found [] 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 9 to test-NodeD-25447: SuccessfulResponse([]) 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #9, conn_id=2) 14:54:28,220 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #8, conn_id=1) 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#8 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received request 17 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={134}} 14:54:28,220 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={134}} [sender=test-NodeB-18592] 14:54:28,220 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=9, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #9, conn_id=2) 14:54:28,220 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={134}} 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#9 14:54:28,220 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Received request for transactions from node test-NodeB-18592 for cache opt-cache, topology id 10, segments {134} 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 9 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,220 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_CACHE_LISTENERS, topologyId=9, segments=null} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,220 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Found 0 transaction(s) to transfer 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 17 to test-NodeB-18592: SuccessfulResponse([]) 14:54:28,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) On cache opt-cache we have: added segments: [] 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeB-18592: #8, conn_id=1) 14:54:28,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (TestNG) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,220 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (TestNG) Signalling transaction data received for topology 9 14:54:28,220 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,220 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,220 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #8, conn_id=1) 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#8 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received response for request 17 from test-NodeC-10992: SuccessfulResponse([]) 14:54:28,220 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-9,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=10, segments={134}} is {test-NodeC-10992=SuccessfulResponse([])} 14:54:28,220 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,220 DEBUG [org.infinispan.transaction.impl.TransactionTable] (TestNG) Topology changed, recalculating minTopologyId 14:54:28,220 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Applying 0 transactions for cache opt-cache transferred from node test-NodeC-10992 14:54:28,220 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Changing minimum topology ID from -1 to 9 14:54:28,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Adding transfer from test-NodeA-55522 for segments {53-54 135-136} 14:54:28,220 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=null, writeConsistentHashAtStart=null, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionConsistentHash=null, newTopologyId=9} 14:54:28,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Adding transfer from test-NodeC-10992 for segments {134} 14:54:28,220 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is null 14:54:28,220 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t1) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {53-54 135-136} 14:54:28,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Finished adding inbound state transfer for segments {53-54 134-136} 14:54:28,220 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={53-54 135-136}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,220 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (TestNG) Updating stable topology for cache opt-cache: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,220 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = 10, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,220 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 sending request 18 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={53-54 135-136}} 14:54:28,220 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 10 14:54:28,220 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 --> DATA(test-NodeA-55522: #38, conn_id=0) 14:54:28,220 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Check if topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,220 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,220 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:28,220 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) On stable topology update. Pending txs: 0 14:54:28,220 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,220 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) StateTransferManager of cache opt-cache on node test-NodeD-25447 received initial topology CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,221 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,221 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Topology changed, recalculating minTopologyId 14:54:28,221 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Changing minimum topology ID from 9 to 10 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeD-25447 sending request 10 to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=test-NodeD-25447, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeD-25447 --> DATA(test-NodeA-55522: #15, conn_id=0) 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=65 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,221 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t2) Updating local topology for cache opt-cache: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #38, conn_id=0) 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#38 14:54:28,221 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t2) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,221 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received request 18 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={53-54 135-136}} 14:54:28,221 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) On stable topology update. Pending txs: 0 14:54:28,221 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={53-54 135-136}} [sender=test-NodeB-18592] 14:54:28,221 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,221 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={53-54 135-136}} 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=20 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=15, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Starting outbound transfer to node test-NodeB-18592 for cache opt-cache, topology id 10, segments {53-54 135-136} 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #15, conn_id=0) 14:54:28,221 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#15 14:54:28,221 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Adding outbound transfer to test-NodeB-18592 for segments [53, 54, 135, 136] 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 10 from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:28,221 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeD-25447] 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 18 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,221 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #17, conn_id=0) 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 10 to test-NodeD-25447: SuccessfulResponse(true) 14:54:28,221 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,221 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t4) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [53, 54, 135, 136] 14:54:28,221 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,221 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t2) Installing new cache topology CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending request 10 to test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #18, conn_id=0) 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #10, conn_id=2) 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t2) This is the first topology 10 in which the local node is a member 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=82 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #18, conn_id=0) 14:54:28,221 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#18 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #10, conn_id=2) 14:54:28,221 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#10 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 10 from test-NodeA-55522: SuccessfulResponse(true) 14:54:28,221 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,222 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (TestNG) Waiting for initial state transfer to finish for cache opt-cache on test-NodeD-25447 14:54:28,222 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,222 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 14:54:28,222 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #17, conn_id=0) 14:54:28,222 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#17 14:54:28,222 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 18 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,222 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={53-54 135-136}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,222 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t1) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {53-54 135-136} 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments={53-54 135-136}, finishedSegments={}, unfinishedSegments={53-54 135-136}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@27855115[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,222 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@6342a1e4 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=10} 14:54:28,222 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t2) (isRunning=true) Installed new topology 10: CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Start keeping track of keys for rebalance 14:54:28,222 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,222 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t2) Tracking is disabled. Clear tracker: {} 14:54:28,222 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t2) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,222 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling topology 10 is installed 14:54:28,221 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 10 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} 14:54:28,222 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} [sender=test-NodeA-55522] 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache opt-cache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: [] 14:54:28,222 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-9,test-NodeB-18592) Checking if transaction data was received for topology 10, current topology is 10 14:54:28,222 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache opt-cache we have: added segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; removed segments: {} 14:54:28,222 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} 14:54:28,222 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Adding inbound state transfer for segments {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Requesting transactions from node test-NodeA-55522 for segments {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 135 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 53 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 53 of cache opt-cache 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 3 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 54 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,222 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 135 of cache opt-cache 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 136 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 136 of cache opt-cache 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 1 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 54 of cache opt-cache 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 2 14:54:28,222 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 sending request 11 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} 14:54:28,222 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished receiving state for segments {53-54 135-136} 14:54:28,222 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 --> DATA(test-NodeA-55522: #16, conn_id=0) 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Inbound transfer finished: InboundTransferTask{segments={53-54 135-136}, finishedSegments={53-54 135-136}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@27855115[Completed normally], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,222 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Removing inbound transfers from node {53-54 135-136} for segments test-NodeA-55522 14:54:28,222 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 0 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Segments not received yet for cache opt-cache: {test-NodeC-10992=[InboundTransferTask{segments={134}, finishedSegments={}, unfinishedSegments={134}, source=test-NodeC-10992, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@486bf1f1[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache}]} 14:54:28,223 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeC-10992 for segments {134} 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 10 to test-NodeA-55522: null 14:54:28,223 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={134}} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #39, conn_id=0) 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=329 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=16, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 sending request 19 to test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={134}} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 --> DATA(test-NodeC-10992: #9, conn_id=1) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #16, conn_id=0) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#16 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=10, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 11 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #39, conn_id=0) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#39 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} [sender=test-NodeD-25447] 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 10 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,223 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #9, conn_id=1) 14:54:28,223 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Received request for transactions from node test-NodeD-25447 for cache opt-cache, topology id 10, segments {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#9 14:54:28,223 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t4) Completed outbound transfer to node test-NodeB-18592, segments [53, 54, 135, 136] 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received request 19 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={134}} 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={134}} [sender=test-NodeB-18592] 14:54:28,223 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Found 0 transaction(s) to transfer 14:54:28,223 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={134}} 14:54:28,223 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t4) Removing completed outbound transfer of segments to test-NodeB-18592 for cache opt-cache, segments [53, 54, 135, 136] 14:54:28,223 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Starting outbound transfer to node test-NodeB-18592 for cache opt-cache, topology id 10, segments {134} 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 11 to test-NodeD-25447: SuccessfulResponse([]) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #11, conn_id=2) 14:54:28,223 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Adding outbound transfer to test-NodeB-18592 for segments [134] 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 19 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,223 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeC-p148-t2) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [134] 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeB-18592: #9, conn_id=1) 14:54:28,223 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 sending request 16 to test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #11, conn_id=2) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 --> DATA(test-NodeB-18592: #10, conn_id=1) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#11 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 11 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #9, conn_id=1) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#9 14:54:28,223 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received response for request 19 from test-NodeC-10992: SuccessfulResponse(null) 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Requesting transactions from node test-NodeB-18592 for segments {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} 14:54:28,223 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-9,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=10, segments={134}} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=52 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,223 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeC-10992 for segments {134} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #10, conn_id=1) 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#10 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 sending request 12 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={134}, finishedSegments={}, unfinishedSegments={134}, source=test-NodeC-10992, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@486bf1f1[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 --> DATA(test-NodeB-18592: #3, conn_id=1) 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 16 from test-NodeC-10992: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} [sender=test-NodeC-10992] 14:54:28,223 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeB-18592) Checking if transaction data was received for topology 10, current topology is 10 14:54:28,223 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,223 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=323 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 134 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #3, conn_id=1) 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 134 of cache opt-cache 14:54:28,223 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#3 14:54:28,223 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished receiving state for segments {134} 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 12 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Inbound transfer finished: InboundTransferTask{segments={134}, finishedSegments={134}, unfinishedSegments={}, source=test-NodeC-10992, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@486bf1f1[Completed normally], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} [sender=test-NodeD-25447] 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Removing inbound transfers from node {134} for segments test-NodeC-10992 14:54:28,223 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,223 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished receiving of segments for cache opt-cache for topology 10. 14:54:28,223 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} 14:54:28,223 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,223 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,223 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Received request for transactions from node test-NodeD-25447 for cache opt-cache, topology id 10, segments {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} 14:54:28,223 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t4) Tracking is disabled. Clear tracker: {} 14:54:28,223 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Found 0 transaction(s) to transfer 14:54:28,223 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 12 to test-NodeD-25447: SuccessfulResponse([]) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #40, conn_id=0) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeD-25447: #3, conn_id=2) 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 0 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t6) Segments not received yet for cache opt-cache: {} 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 16 to test-NodeC-10992: null 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #3, conn_id=2) 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeC-10992: #10, conn_id=1) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #40, conn_id=0) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#40 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#3 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=10, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 12 from test-NodeB-18592: SuccessfulResponse([]) 14:54:28,224 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=10, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,224 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} is {test-NodeB-18592=SuccessfulResponse([])} 14:54:28,224 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,224 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 10 14:54:28,224 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Applying 0 transactions for cache opt-cache transferred from node test-NodeB-18592 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Requesting transactions from node test-NodeC-10992 for segments {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #10, conn_id=1) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#10 14:54:28,224 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,224 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 10 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 16 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,224 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 10@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeD-25447] 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 sending request 13 to test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} 14:54:28,224 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-10,test-NodeC-10992) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 --> DATA(test-NodeC-10992: #3, conn_id=2) 14:54:28,224 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeC-p148-t2) Completed outbound transfer to node test-NodeB-18592, segments [134] 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeC-p148-t2) Removing completed outbound transfer of segments to test-NodeB-18592 for cache opt-cache, segments [134] 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=269 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #3, conn_id=2) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#3 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received request 13 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} 14:54:28,224 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} [sender=test-NodeD-25447] 14:54:28,224 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,224 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} 14:54:28,224 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Received request for transactions from node test-NodeD-25447 for cache opt-cache, topology id 10, segments {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} 14:54:28,224 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Found 0 transaction(s) to transfer 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 13 to test-NodeD-25447: SuccessfulResponse([]) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeD-25447: #3, conn_id=2) 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=3, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #3, conn_id=2) 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#3 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 13 from test-NodeC-10992: SuccessfulResponse([]) 14:54:28,224 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} is {test-NodeC-10992=SuccessfulResponse([])} 14:54:28,224 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Applying 0 transactions for cache opt-cache transferred from node test-NodeC-10992 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Adding transfer from test-NodeA-55522 for segments {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Adding transfer from test-NodeB-18592 for segments {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} 14:54:28,224 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Adding transfer from test-NodeC-10992 for segments {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} 14:54:28,224 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,224 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 sending request 14 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Finished adding inbound state transfer for segments {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 --> DATA(test-NodeA-55522: #17, conn_id=0) 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Topology update processed, stateTransferTopologyId = 10, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,224 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling transaction data received for topology 10 14:54:28,224 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,224 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,224 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=329 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=17, TP: [cluster_name=ISPN] 14:54:28,224 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #17, conn_id=0) 14:54:28,225 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#17 14:54:28,225 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received request 14 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} 14:54:28,225 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,225 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} [sender=test-NodeD-25447] 14:54:28,225 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Topology changed, recalculating minTopologyId 14:54:28,225 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Changing minimum topology ID from 9 to 10 14:54:28,225 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,225 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} 14:54:28,225 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Starting outbound transfer to node test-NodeD-25447 for cache opt-cache, topology id 10, segments {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} 14:54:28,225 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=10} 14:54:28,225 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Adding outbound transfer to test-NodeD-25447 for segments [0, 1, 4, 9, 10, 11, 12, 14, 34, 35, 43, 44, 52, 53, 63, 64, 71, 77, 110, 117, 122, 123, 130, 135, 152, 153, 156, 167, 169, 170, 171, 200, 201, 202, 204, 209, 213, 216, 217, 224, 228, 231, 232, 234, 237, 238, 239, 255] 14:54:28,225 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 14 to test-NodeD-25447: SuccessfulResponse(null) 14:54:28,225 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t2) Check if topology CacheTopology{id=10, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,225 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #12, conn_id=2) 14:54:28,225 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t2) On stable topology update. Pending txs: 0 14:54:28,225 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t2) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [0, 1, 4, 9, 10, 11, 12, 14, 34, 35, 43, 44, 52, 53, 63, 64, 71, 77, 110, 117, 122, 123, 130, 135, 152, 153, 156, 167, 169, 170, 171, 200, 201, 202, 204, 209, 213, 216, 217, 224, 228, 231, 232, 234, 237, 238, 239, 255] 14:54:28,225 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,225 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,225 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,225 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #12, conn_id=2) 14:54:28,225 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#12 14:54:28,225 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 sending request 11 to test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} 14:54:28,225 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 14 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,225 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 --> DATA(test-NodeD-25447: #13, conn_id=2) 14:54:28,225 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,225 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,225 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}, finishedSegments={}, unfinishedSegments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@8449dcc[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,225 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=522 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,225 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #13, conn_id=2) 14:54:28,225 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#13 14:54:28,225 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 11 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} 14:54:28,225 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} [sender=test-NodeA-55522] 14:54:28,225 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeD-25447) Checking if transaction data was received for topology 10, current topology is 10 14:54:28,225 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,225 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 0 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 4 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 0 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 10 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 47 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 1 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 9 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 1 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 46 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 10 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 4 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 45 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 9 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 44 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 43 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 11 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 12 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 34 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 14 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 11 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 34 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 12 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 41 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 42 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 35 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 14 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 35 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 43 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 40 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 39 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 43 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 38 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 37 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 63 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 44 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 63 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 53 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 36 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 52 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 64 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 64 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 35 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 53 of cache opt-cache 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 52 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 34 14:54:28,225 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 71 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 71 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 44 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 32 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 33 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 117 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 117 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 31 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 77 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 30 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 77 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 110 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 110 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 28 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 29 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 122 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 130 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 123 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 130 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 122 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 26 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 27 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 123 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 25 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 156 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 153 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 152 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 135 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 153 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 24 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 135 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 152 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 23 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 156 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 22 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 21 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 167 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 169 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 167 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 171 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 20 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 200 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 200 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 19 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 170 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 202 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 169 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 171 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 18 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 202 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 201 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 170 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 16 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 201 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 15 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 14 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 17 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 204 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 216 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 204 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 209 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 13 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 217 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 213 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 213 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 209 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 11 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 12 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 217 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 216 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 10 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 9 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 224 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 231 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 228 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 232 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 231 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 232 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 224 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 8 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 228 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 237 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 237 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 234 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 5 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 4 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 7 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 238 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 6 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 234 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 238 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 3 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 2 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 239 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 255 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 239 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 255 of cache opt-cache 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 1 14:54:28,226 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished receiving state for segments {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Inbound transfer finished: InboundTransferTask{segments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}, finishedSegments={0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@8449dcc[Completed normally], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Removing inbound transfers from node {0-1 4 9-12 14 34-35 43-44 52-53 63-64 71 77 110 117 122-123 130 135 152-153 156 167 169-171 200-202 204 209 213 216-217 224 228 231-232 234 237-239 255} for segments test-NodeA-55522 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 0 14:54:28,226 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,226 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} 14:54:28,227 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Segments not received yet for cache opt-cache: {test-NodeB-18592=[InboundTransferTask{segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}, finishedSegments={}, unfinishedSegments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3c94f930[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache}], test-NodeC-10992=[InboundTransferTask{segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, finishedSegments={}, unfinishedSegments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, source=test-NodeC-10992, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3fe1ab17[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache}]} 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 sending request 15 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 11 to test-NodeA-55522: null 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 --> DATA(test-NodeB-18592: #4, conn_id=1) 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeA-55522: #18, conn_id=0) 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=11, rsp_expected=true, UNICAST3: DATA, seqno=18, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=323 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #18, conn_id=0) 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #4, conn_id=1) 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#18 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#4 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 11 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 15 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} 14:54:28,227 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} [sender=test-NodeD-25447] 14:54:28,227 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=1, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=4, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=9, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=10, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=11, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=12, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=14, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=34, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=35, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=43, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=52, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=53, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=63, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=64, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=71, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=77, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=117, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=122, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=123, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=130, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=152, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=153, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=156, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=167, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=169, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=170, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=171, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=200, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=201, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=202, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=204, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=209, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=213, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=216, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=224, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=228, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=231, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=232, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=234, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=237, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=238, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=239, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=255, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=10, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,227 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,227 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} 14:54:28,227 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t2) Completed outbound transfer to node test-NodeD-25447, segments [0, 1, 4, 9, 10, 11, 12, 14, 34, 35, 43, 44, 52, 53, 63, 64, 71, 77, 110, 117, 122, 123, 130, 135, 152, 153, 156, 167, 169, 170, 171, 200, 201, 202, 204, 209, 213, 216, 217, 224, 228, 231, 232, 234, 237, 238, 239, 255] 14:54:28,227 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Starting outbound transfer to node test-NodeD-25447 for cache opt-cache, topology id 10, segments {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} 14:54:28,227 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t2) Removing completed outbound transfer of segments to test-NodeD-25447 for cache opt-cache, segments [0, 1, 4, 9, 10, 11, 12, 14, 34, 35, 43, 44, 52, 53, 63, 64, 71, 77, 110, 117, 122, 123, 130, 135, 152, 153, 156, 167, 169, 170, 171, 200, 201, 202, 204, 209, 213, 216, 217, 224, 228, 231, 232, 234, 237, 238, 239, 255] 14:54:28,227 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Adding outbound transfer to test-NodeD-25447 for segments [15, 20, 21, 23, 25, 33, 38, 60, 62, 72, 78, 84, 85, 87, 88, 96, 97, 99, 104, 106, 116, 120, 127, 128, 131, 133, 140, 141, 145, 147, 155, 179, 182, 183, 185, 186, 205, 206, 210, 212, 219, 220, 233, 240, 241, 242, 243] 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 15 to test-NodeD-25447: SuccessfulResponse(null) 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeD-25447: #4, conn_id=2) 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t6) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [15, 20, 21, 23, 25, 33, 38, 60, 62, 72, 78, 84, 85, 87, 88, 96, 97, 99, 104, 106, 116, 120, 127, 128, 131, 133, 140, 141, 145, 147, 155, 179, 182, 183, 185, 186, 205, 206, 210, 212, 219, 220, 233, 240, 241, 242, 243] 14:54:28,227 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=10, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #4, conn_id=2) 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#4 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 15 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 sending request 20 to test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=10, applyState=true} 14:54:28,227 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 --> DATA(test-NodeD-25447: #5, conn_id=2) 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}, finishedSegments={}, unfinishedSegments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3c94f930[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,227 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=512 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #5, conn_id=2) 14:54:28,227 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#5 14:54:28,227 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 20 from test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=10, applyState=true} 14:54:28,227 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=10, applyState=true} [sender=test-NodeB-18592] 14:54:28,227 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeD-25447) Checking if transaction data was received for topology 10, current topology is 10 14:54:28,227 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,227 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=10, applyState=true} 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 15 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 21 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 15 of cache opt-cache 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 21 of cache opt-cache 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 20 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 45 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 25 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 25 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 46 14:54:28,227 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 23 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 44 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 20 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 23 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 38 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 60 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 38 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 43 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 41 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 33 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 60 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 33 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 42 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 39 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 40 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 62 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 78 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 84 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 62 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 72 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 84 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 72 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 78 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 36 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 35 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 38 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 88 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 87 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 37 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 88 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 85 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 87 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 34 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 85 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 32 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 33 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 99 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 96 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 97 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 99 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 96 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 97 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 31 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 29 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 30 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 104 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 120 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 106 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 116 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 127 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 116 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 106 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 120 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 27 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 104 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 26 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 25 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 28 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 127 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 24 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 131 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 128 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 140 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 141 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 133 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 141 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 140 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 23 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 131 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 145 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 145 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 22 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 21 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 128 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 147 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 155 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 133 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 155 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 147 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 18 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 19 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 20 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 179 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 179 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 16 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 17 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 182 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 185 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 15 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 185 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 183 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 183 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 14 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 182 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 13 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 186 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 206 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 12 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 186 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 11 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 205 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 206 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 205 of cache opt-cache 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 10 14:54:28,228 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 9 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 210 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 219 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 212 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 220 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 219 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 210 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 220 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 212 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 6 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 7 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 240 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 233 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 8 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 233 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 5 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 240 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 4 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 243 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 3 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 242 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 241 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 243 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 2 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 241 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 242 of cache opt-cache 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 1 14:54:28,229 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished receiving state for segments {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Inbound transfer finished: InboundTransferTask{segments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}, finishedSegments={15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3c94f930[Completed normally], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Removing inbound transfers from node {15 20-21 23 25 33 38 60 62 72 78 84-85 87-88 96-97 99 104 106 116 120 127-128 131 133 140-141 145 147 155 179 182-183 185-186 205-206 210 212 219-220 233 240-243} for segments test-NodeB-18592 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 0 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,229 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeC-10992 for segments {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Segments not received yet for cache opt-cache: {test-NodeC-10992=[InboundTransferTask{segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, finishedSegments={}, unfinishedSegments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, source=test-NodeC-10992, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3fe1ab17[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache}]} 14:54:28,229 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,229 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 20 to test-NodeB-18592: null 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeB-18592: #5, conn_id=1) 14:54:28,229 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 sending request 16 to test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 --> DATA(test-NodeC-10992: #4, conn_id=2) 14:54:28,229 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,229 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,229 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=269 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,229 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #4, conn_id=2) 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #5, conn_id=1) 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#4 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#5 14:54:28,229 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 20 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,229 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received request 16 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} 14:54:28,229 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} [sender=test-NodeD-25447] 14:54:28,229 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,229 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=20, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=21, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=23, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=25, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=33, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=38, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=60, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=62, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=72, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=78, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=84, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=87, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=88, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=96, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=104, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=106, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=116, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=120, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=127, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=128, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=133, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=147, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=155, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=179, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=182, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=185, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=186, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=205, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=206, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=210, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=212, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=219, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=220, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=233, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=240, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=241, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=242, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=243, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=10, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,229 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} 14:54:28,229 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Starting outbound transfer to node test-NodeD-25447 for cache opt-cache, topology id 10, segments {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} 14:54:28,229 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t6) Completed outbound transfer to node test-NodeD-25447, segments [15, 20, 21, 23, 25, 33, 38, 60, 62, 72, 78, 84, 85, 87, 88, 96, 97, 99, 104, 106, 116, 120, 127, 128, 131, 133, 140, 141, 145, 147, 155, 179, 182, 183, 185, 186, 205, 206, 210, 212, 219, 220, 233, 240, 241, 242, 243] 14:54:28,229 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeC-p146-t5) Adding outbound transfer to test-NodeD-25447 for segments [5, 24, 26, 32, 36, 37, 58, 59, 73, 76, 79, 98, 100, 105, 108, 109, 114, 115, 121, 124, 125, 126, 129, 134, 139, 144, 146, 154, 157, 166, 178, 187, 198, 199, 203, 222, 223, 229] 14:54:28,229 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t6) Removing completed outbound transfer of segments to test-NodeD-25447 for cache opt-cache, segments [15, 20, 21, 23, 25, 33, 38, 60, 62, 72, 78, 84, 85, 87, 88, 96, 97, 99, 104, 106, 116, 120, 127, 128, 131, 133, 140, 141, 145, 147, 155, 179, 182, 183, 185, 186, 205, 206, 210, 212, 219, 220, 233, 240, 241, 242, 243] 14:54:28,229 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 16 to test-NodeD-25447: SuccessfulResponse(null) 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeD-25447: #4, conn_id=2) 14:54:28,229 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,229 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeC-p148-t3) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [5, 24, 26, 32, 36, 37, 58, 59, 73, 76, 79, 98, 100, 105, 108, 109, 114, 115, 121, 124, 125, 126, 129, 134, 139, 144, 146, 154, 157, 166, 178, 187, 198, 199, 203, 222, 223, 229] 14:54:28,229 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,229 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=4, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #4, conn_id=2) 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#4 14:54:28,229 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 sending request 17 to test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} 14:54:28,229 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 16 from test-NodeC-10992: SuccessfulResponse(null) 14:54:28,229 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 --> DATA(test-NodeD-25447: #5, conn_id=2) 14:54:28,229 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,229 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=10, segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:28,229 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeC-10992 for segments {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} 14:54:28,229 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, finishedSegments={}, unfinishedSegments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, source=test-NodeC-10992, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3fe1ab17[Not completed], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,230 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=422 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,230 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #5, conn_id=2) 14:54:28,230 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#5 14:54:28,230 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 17 from test-NodeC-10992: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} 14:54:28,230 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} [sender=test-NodeC-10992] 14:54:28,230 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeD-25447) Checking if transaction data was received for topology 10, current topology is 10 14:54:28,230 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,230 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 36 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 32 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 24 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 26 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 5 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 26 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 24 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 32 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 36 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 36 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 35 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 34 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 58 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 37 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 58 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 37 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 5 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 33 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 37 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 76 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 32 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 76 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 73 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 30 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 59 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 31 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 79 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 79 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 59 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 29 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 73 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 105 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 28 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 98 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 27 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 100 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 105 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 26 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 98 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 25 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 108 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 100 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 109 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 24 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 114 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 114 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 108 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 23 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 109 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 124 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 124 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 21 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 121 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 125 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 22 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 115 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 125 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 115 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 19 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 20 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 121 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 18 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 17 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 139 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 129 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 126 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 134 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 139 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 126 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 16 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 129 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 146 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 146 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 134 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 13 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 14 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 15 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 144 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 154 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 144 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 12 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 11 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 154 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 10 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 157 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 178 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 178 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 9 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 166 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 198 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 166 of cache opt-cache 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 187 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 8 14:54:28,230 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 157 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 7 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 187 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 6 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 198 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 5 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 199 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 223 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 229 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 223 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 203 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 4 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 222 of cache opt-cache from node test-NodeC-10992: received 0 cache entries 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 222 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 199 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 3 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 229 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 2 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 203 of cache opt-cache 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 1 14:54:28,231 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished receiving state for segments {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Inbound transfer finished: InboundTransferTask{segments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, finishedSegments={5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229}, unfinishedSegments={}, source=test-NodeC-10992, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3fe1ab17[Completed normally], topologyId=10, timeout=240000, cacheName=opt-cache} 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Removing inbound transfers from node {5 24 26 32 36-37 58-59 73 76 79 98 100 105 108-109 114-115 121 124-126 129 134 139 144 146 154 157 166 178 187 198-199 203 222-223 229} for segments test-NodeC-10992 14:54:28,231 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished receiving of segments for cache opt-cache for topology 10. 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,231 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,231 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t4) Tracking is disabled. Clear tracker: {} 14:54:28,231 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,231 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #19, conn_id=0) 14:54:28,231 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 0 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,231 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Segments not received yet for cache opt-cache: {} 14:54:28,231 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 17 to test-NodeC-10992: null 14:54:28,231 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 14:54:28,231 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeC-10992: #5, conn_id=2) 14:54:28,231 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #19, conn_id=0) 14:54:28,231 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#19 14:54:28,231 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,231 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=10, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,231 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=10, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeD-25447] 14:54:28,231 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,231 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 10 14:54:28,231 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=5, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,231 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #5, conn_id=2) 14:54:28,231 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#5 14:54:28,231 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received response for request 17 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,231 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 10 14:54:28,231 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 10@opt-cache received confirmation for test-NodeD-25447, remaining list is [] 14:54:28,231 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000336: Finished cluster-wide rebalance for cache opt-cache, topology id = 10 14:54:28,231 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-10,test-NodeC-10992) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=24, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=26, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=73, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=79, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=105, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=121, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=126, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=129, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=154, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=157, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=187, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=199, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=203, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeC-10992, topologyId=10, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,231 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeC-p148-t3) Completed outbound transfer to node test-NodeD-25447, segments [5, 24, 26, 32, 36, 37, 58, 59, 73, 76, 79, 98, 100, 105, 108, 109, 114, 115, 121, 124, 125, 126, 129, 134, 139, 144, 146, 154, 157, 166, 178, 187, 198, 199, 203, 222, 223, 229] 14:54:28,231 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeD-25447] 14:54:28,231 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeC-p148-t3) Removing completed outbound transfer of segments to test-NodeD-25447 for cache opt-cache, segments [5, 24, 26, 32, 36, 37, 58, 59, 73, 76, 79, 98, 100, 105, 108, 109, 114, 115, 121, 124, 125, 126, 129, 134, 139, 144, 146, 154, 157, 166, 178, 187, 198, 199, 203, 222, 223, 229] 14:54:28,231 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,231 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,231 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 11@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,231 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,232 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,232 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,232 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Updating local topology for cache opt-cache: CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#34 14:54:28,232 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=34], TP: [cluster_name=ISPN] 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,232 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=34], TP: [cluster_name=ISPN] 14:54:28,232 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=34], TP: [cluster_name=ISPN] 14:54:28,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#34 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#34 14:54:28,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#34 14:54:28,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#34 14:54:28,232 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=34], TP: [cluster_name=ISPN] 14:54:28,232 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6562 credits, 1860621 remaining 14:54:28,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#34 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Union consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 53-54 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 134-136 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} test-NodeD-25447 primary: {}, backup: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,232 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#34 14:54:28,232 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,232 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,232 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t6) Installing new cache topology CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,232 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,232 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,232 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,232 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,232 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,232 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,232 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,232 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 6562 credits, 1883301 remaining 14:54:28,232 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,232 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating local topology for cache opt-cache: CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,232 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t3) Updating local topology for cache opt-cache: CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,232 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 6562 credits, 1860621 remaining 14:54:28,232 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,232 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t1) Updating local topology for cache opt-cache: CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,232 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,232 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t6) (isRunning=true) Installed new topology 11: CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,232 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling topology 11 is installed 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,232 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache opt-cache we have: new segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255}; old segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255} 14:54:28,232 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 53-54 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 134-136 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} test-NodeD-25447 primary: {}, backup: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,232 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Topology update processed, stateTransferTopologyId = 10, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,232 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,232 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,232 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t6) Tracking is disabled. Clear tracker: {} 14:54:28,232 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@4b9c7f08 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t6) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 11 and was pre false 14:54:28,233 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t6) No change listeners present! 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Unlock State Transfer in Progress for topology ID 11 14:54:28,233 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling transaction data received for topology 11 14:54:28,233 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,233 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,233 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,233 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 11 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,233 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) Topology changed, recalculating minTopologyId 14:54:28,233 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) Changing minimum topology ID from 10 to 11 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) Check if topology CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,233 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) On stable topology update. Pending txs: 0 14:54:28,232 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 6562 credits, 1909435 remaining 14:54:28,233 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 11 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 53-54 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 134-136 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} test-NodeD-25447 primary: {}, backup: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,232 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t1) Installing new cache topology CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,233 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 53-54 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 134-136 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} test-NodeD-25447 primary: {}, backup: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t4) Installing new cache topology CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t1) (isRunning=true) Installed new topology 11: CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling topology 11 is installed 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache opt-cache we have: new segments: {9-17 19-25 27-33 36-38 40-41 50-51 53-54 56-74 77-80 83-89 92-107 114-120 124-128 130-136 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251}; old segments: {9-17 19-25 27-33 36-38 40-41 50-51 53-54 56-74 77-80 83-89 92-107 114-120 124-128 130-136 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,233 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t4) (isRunning=true) Installed new topology 11: CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Topology update processed, stateTransferTopologyId = 10, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t4) Signalling topology 11 is installed 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) On cache opt-cache we have: new segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; old segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Topology update processed, stateTransferTopologyId = 10, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,233 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,233 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t4) Tracking is disabled. Clear tracker: {} 14:54:28,233 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@37794112 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,233 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 11 and was pre false 14:54:28,234 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t4) No change listeners present! 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@2eec5549 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Unlock State Transfer in Progress for topology ID 11 14:54:28,234 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t4) Signalling transaction data received for topology 11 14:54:28,234 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,234 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,234 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,234 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 --> DATA(test-NodeA-55522: #28, conn_id=0) 14:54:28,234 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,234 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Topology changed, recalculating minTopologyId 14:54:28,234 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Changing minimum topology ID from 10 to 11 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,234 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) Check if topology CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,234 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) On stable topology update. Pending txs: 0 14:54:28,233 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t5) Rebalance confirmation collector 11@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,234 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,233 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,234 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #28, conn_id=0) 14:54:28,233 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t3) Installing new cache topology CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,234 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#28 14:54:28,234 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,234 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t1) Tracking is disabled. Clear tracker: {} 14:54:28,234 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=11, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,234 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=11, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeC-10992] 14:54:28,234 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,234 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 11 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@634a99a1 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,234 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 11 14:54:28,234 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t1) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 11 and was pre false 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,234 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t1) No change listeners present! 14:54:28,234 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 11@opt-cache received confirmation for test-NodeC-10992, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:28,234 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t3) (isRunning=true) Installed new topology 11: CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,234 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling topology 11 is installed 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Unlock State Transfer in Progress for topology ID 11 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache opt-cache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,234 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling transaction data received for topology 11 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,234 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Topology update processed, stateTransferTopologyId = 10, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,234 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Stop keeping track of changed keys for state transfer in topology 10 14:54:28,234 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,234 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t3) Tracking is disabled. Clear tracker: {} 14:54:28,234 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,234 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 --> DATA(test-NodeA-55522: #41, conn_id=0) 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@33b8274d passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,234 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:28,234 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t3) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 11 and was pre false 14:54:28,234 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t3) No change listeners present! 14:54:28,234 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@6342a1e4 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, newTopologyId=11} 14:54:28,234 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Unlock State Transfer in Progress for topology ID 11 14:54:28,234 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling transaction data received for topology 11 14:54:28,235 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,235 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,235 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,235 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Topology changed, recalculating minTopologyId 14:54:28,235 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:28,235 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Changing minimum topology ID from 10 to 11 14:54:28,235 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #41, conn_id=0) 14:54:28,235 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#41 14:54:28,235 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,235 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 --> DATA(test-NodeA-55522: #20, conn_id=0) 14:54:28,235 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=11, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,235 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,235 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=11, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,235 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 14:54:28,235 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,235 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 11 14:54:28,235 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) Check if topology CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,235 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 11 14:54:28,235 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) On stable topology update. Pending txs: 0 14:54:28,235 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 11@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeD-25447] 14:54:28,235 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 14:54:28,235 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,235 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #20, conn_id=0) 14:54:28,235 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) Topology changed, recalculating minTopologyId 14:54:28,235 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#20 14:54:28,235 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) Changing minimum topology ID from 10 to 11 14:54:28,235 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=11, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,235 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=11, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeD-25447] 14:54:28,235 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,235 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 11 14:54:28,235 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, unionConsistentHash=null, newTopologyId=11} 14:54:28,235 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 11 14:54:28,235 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 11@opt-cache received confirmation for test-NodeD-25447, remaining list is [] 14:54:28,235 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) Check if topology CacheTopology{id=11, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,235 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) On stable topology update. Pending txs: 0 14:54:28,235 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeD-25447] 14:54:28,235 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,235 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,235 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 12@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,235 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,235 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,235 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,235 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#35 14:54:28,235 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,235 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=35], TP: [cluster_name=ISPN] 14:54:28,235 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,235 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6562 credits, 1854059 remaining 14:54:28,235 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=35], TP: [cluster_name=ISPN] 14:54:28,235 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=35], TP: [cluster_name=ISPN] 14:54:28,235 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#35 14:54:28,235 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#35 14:54:28,235 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#35 14:54:28,235 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,235 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#35 14:54:28,235 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=35], TP: [cluster_name=ISPN] 14:54:28,235 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#35 14:54:28,235 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#35 14:54:28,235 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,235 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,235 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 5-8 10 12-13 17 20-21 26 33 38 42 44-46 48 51 53-55 60 62-64 67 69-70 74 76-77 81 90 93 102 108-111 116-117 121-122 129 134-137 142 147 149 151 155-157 159-160 166-168 171-172 176 187 190 194 198-199 203-206 208 210 212-213 215 217 219-220 222-224 227 229-230 233-234 236 240-243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {9-12 14-16 19 21-22 24 27 29 32-33 36-38 40 50 53 56 58-61 63-64 66 68 71-73 77 79 83 85-86 88 92 94-95 97-101 103 105-106 114-119 124-127 130-132 134-135 139-141 144-148 150 154 158 161 167 169-171 174-175 178-179 181 183-184 189 193 196 204-207 209-211 213-214 218 220 224 231-235 237-241 243 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {0-2 4-5 15 18 23-26 28 30-31 34-36 39 41 43-44 47 49 52-54 57 65 72-73 75 78-80 82 84-85 87-89 91 96-97 99-100 104-107 110 112-113 120-124 126-129 131 133-136 138 140-141 143 145 152-154 156-157 162-165 173 177 179-180 182-183 185-188 191-192 195 197 199-203 216-217 221 225-226 228-229 244 246 248-249 252 255} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,236 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,236 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,236 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,236 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,236 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 6562 credits, 1854059 remaining 14:54:28,236 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,236 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,236 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 6562 credits, 1876739 remaining 14:54:28,236 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,236 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 6562 credits, 1902873 remaining 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,236 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Updating local topology for cache opt-cache: CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating local topology for cache opt-cache: CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Updating local topology for cache opt-cache: CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0-2 4 9-12 14 18 22 27 34-35 39 43-44 47 49 52-54 56 61 63-64 68 71 75 77 82 91 94-95 103 110 112-113 117-119 122-123 130 135-136 138 143 148 150 152-153 156 158-159 161 167 169-171 173 177 188 191-192 195 200-202 204 207 209 211 213-214 216-217 221 224 228 231-232 234-235 237-239 244 252 255}, backup: {3 5-8 13 17 20-21 26 33 38 42 45-46 48 51 55 60 62 67 69-70 74 76 81 90 93 102 108-109 111 116 121 129 134 137 142 147 149 151 155 157 160 166 168 172 176 187 190 194 198-199 203 205-206 208 210 212 215 219-220 222-223 227 229-230 233 236 240-243 251 253-254} test-NodeB-18592 primary: {13 15 17 20-21 23 25 28 30-31 33 38 41 51 57 60 62 65 67 69-70 72 74 78 80 84-85 87-89 93 96-97 99 102 104 106-107 116 120 127-128 131 133 140-141 145 147 149 151 155 160 162-165 168 172 176 179-180 182-183 185-186 190 194 197 205-206 208 210 212 215 219-220 225-226 233 236 240-243 246 248-249 251}, backup: {9-12 14 16 19 22 24 27 29 32 36-37 40 50 56 58-59 61 63-64 66 68 71 73 77 79 83 86 92 94-95 98 100-101 103 105 114-115 117-119 124-126 130 132 139 144 146 148 150 154 158-159 161 167 169-171 174-175 178 181 184 189 193 196 204 207 209 211 213-214 218 224 231-232 234-235 237-239 245 247 250} test-NodeC-10992 primary: {3 5-8 16 19 24 26 29 32 36-37 40 42 45-46 48 50 55 58-59 66 73 76 79 81 83 86 90 92 98 100-101 105 108-109 111 114-115 121 124-126 129 132 134 137 139 142 144 146 154 157 166 174-175 178 181 184 187 189 193 196 198-199 203 218 222-223 227 229-230 245 247 250 253-254}, backup: {0-2 4 15 18 23 25 28 30-31 34-35 39 41 43-44 47 49 52-54 57 65 72 75 78 80 82 84-85 87-89 91 96-97 99 104 106-107 110 112-113 120 122-123 127-128 131 133 135-136 138 140-141 143 145 152-153 156 162-165 173 177 179-180 182-183 185-186 188 191-192 195 197 200-202 216-217 221 225-226 228 244 246 248-249 252 255} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 5-8 10 12-13 17 20-21 26 33 38 42 44-46 48 51 53-55 60 62-64 67 69-70 74 76-77 81 90 93 102 108-111 116-117 121-122 129 134-137 142 147 149 151 155-157 159-160 166-168 171-172 176 187 190 194 198-199 203-206 208 210 212-213 215 217 219-220 222-224 227 229-230 233-234 236 240-243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {9-12 14-16 19 21-22 24 27 29 32-33 36-38 40 50 53 56 58-61 63-64 66 68 71-73 77 79 83 85-86 88 92 94-95 97-101 103 105-106 114-119 124-127 130-132 134-135 139-141 144-148 150 154 158 161 167 169-171 174-175 178-179 181 183-184 189 193 196 204-207 209-211 213-214 218 220 224 231-235 237-241 243 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {0-2 4-5 15 18 23-26 28 30-31 34-36 39 41 43-44 47 49 52-54 57 65 72-73 75 78-80 82 84-85 87-89 91 96-97 99-100 104-107 110 112-113 120-124 126-129 131 133-136 138 140-141 143 145 152-154 156-157 162-165 173 177 179-180 182-183 185-188 191-192 195 197 199-203 216-217 221 225-226 228-229 244 246 248-249 252 255} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 5-8 10 12-13 17 20-21 26 33 38 42 44-46 48 51 53-55 60 62-64 67 69-70 74 76-77 81 90 93 102 108-111 116-117 121-122 129 134-137 142 147 149 151 155-157 159-160 166-168 171-172 176 187 190 194 198-199 203-206 208 210 212-213 215 217 219-220 222-224 227 229-230 233-234 236 240-243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {9-12 14-16 19 21-22 24 27 29 32-33 36-38 40 50 53 56 58-61 63-64 66 68 71-73 77 79 83 85-86 88 92 94-95 97-101 103 105-106 114-119 124-127 130-132 134-135 139-141 144-148 150 154 158 161 167 169-171 174-175 178-179 181 183-184 189 193 196 204-207 209-211 213-214 218 220 224 231-235 237-241 243 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {0-2 4-5 15 18 23-26 28 30-31 34-36 39 41 43-44 47 49 52-54 57 65 72-73 75 78-80 82 84-85 87-89 91 96-97 99-100 104-107 110 112-113 120-124 126-129 131 133-136 138 140-141 143 145 152-154 156-157 162-165 173 177 179-180 182-183 185-188 191-192 195 197 199-203 216-217 221 225-226 228-229 244 246 248-249 252 255} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) Installing new cache topology CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t4) Installing new cache topology CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 5-8 10 12-13 17 20-21 26 33 38 42 44-46 48 51 53-55 60 62-64 67 69-70 74 76-77 81 90 93 102 108-111 116-117 121-122 129 134-137 142 147 149 151 155-157 159-160 166-168 171-172 176 187 190 194 198-199 203-206 208 210 212-213 215 217 219-220 222-224 227 229-230 233-234 236 240-243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {9-12 14-16 19 21-22 24 27 29 32-33 36-38 40 50 53 56 58-61 63-64 66 68 71-73 77 79 83 85-86 88 92 94-95 97-101 103 105-106 114-119 124-127 130-132 134-135 139-141 144-148 150 154 158 161 167 169-171 174-175 178-179 181 183-184 189 193 196 204-207 209-211 213-214 218 220 224 231-235 237-241 243 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {0-2 4-5 15 18 23-26 28 30-31 34-36 39 41 43-44 47 49 52-54 57 65 72-73 75 78-80 82 84-85 87-89 91 96-97 99-100 104-107 110 112-113 120-124 126-129 131 133-136 138 140-141 143 145 152-154 156-157 162-165 173 177 179-180 182-183 185-188 191-192 195 197 199-203 216-217 221 225-226 228-229 244 246 248-249 252 255} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 12: CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t5) Installing new cache topology CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,236 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t2) (isRunning=true) Installed new topology 12: CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling topology 12 is installed 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: new segments: {9-17 19-25 27-33 36-38 40-41 50-51 53-54 56-74 77-80 83-89 92-107 114-120 124-128 130-136 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251}; old segments: {9-17 19-25 27-33 36-38 40-41 50-51 53-54 56-74 77-80 83-89 92-107 114-120 124-128 130-136 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling transaction data received for topology 12 14:54:28,236 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t5) (isRunning=true) Installed new topology 12: CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,236 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,236 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling topology 12 is installed 14:54:28,236 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 12 is installed 14:54:28,236 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: new segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255}; old segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,236 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 --> DATA(test-NodeA-55522: #42, conn_id=0) 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255}; old segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255} 14:54:28,236 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,237 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling transaction data received for topology 12 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,237 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t4) (isRunning=true) Installed new topology 12: CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,237 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling topology 12 is installed 14:54:28,237 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Topology changed, recalculating minTopologyId 14:54:28,236 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,237 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache opt-cache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 --> DATA(test-NodeA-55522: #29, conn_id=0) 14:54:28,237 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Changing minimum topology ID from 11 to 12 14:54:28,237 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,237 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:28,237 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #42, conn_id=0) 14:54:28,237 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 12 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#42 14:54:28,237 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=12, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=12, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeB-18592] 14:54:28,237 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Topology changed, recalculating minTopologyId 14:54:28,237 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #29, conn_id=0) 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#29 14:54:28,237 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=12, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,237 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=12, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeC-10992] 14:54:28,237 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,237 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 12 14:54:28,237 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:28,237 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 12 14:54:28,237 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Changing minimum topology ID from 11 to 12 14:54:28,237 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 12 14:54:28,237 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 12@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeA-55522, test-NodeD-25447, test-NodeC-10992] 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,237 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) On stable topology update. Pending txs: 0 14:54:28,237 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) Check if topology CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,237 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) On stable topology update. Pending txs: 0 14:54:28,237 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 12 14:54:28,237 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling transaction data received for topology 12 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,237 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Rebalance confirmation collector 12@opt-cache received confirmation for test-NodeC-10992, remaining list is [test-NodeA-55522, test-NodeD-25447] 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,237 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,237 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #21, conn_id=0) 14:54:28,237 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t2) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 12 14:54:28,237 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:28,237 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t2) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 12 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Changing minimum topology ID from 11 to 12 14:54:28,237 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t2) Rebalance confirmation collector 12@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeD-25447] 14:54:28,237 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #21, conn_id=0) 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#21 14:54:28,237 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t4) Topology changed, recalculating minTopologyId 14:54:28,237 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t4) Changing minimum topology ID from 11 to 12 14:54:28,237 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=12, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} 14:54:28,237 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=12, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=3} [sender=test-NodeD-25447] 14:54:28,237 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,237 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,237 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 12 14:54:28,237 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) On stable topology update. Pending txs: 0 14:54:28,237 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+92, test-NodeC-10992: 78+93, test-NodeD-25447: 0+133]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=12} 14:54:28,237 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 12 14:54:28,237 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Rebalance confirmation collector 12@opt-cache received confirmation for test-NodeD-25447, remaining list is [] 14:54:28,237 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) Check if topology CacheTopology{id=12, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,238 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) On stable topology update. Pending txs: 0 14:54:28,238 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t4) Cache opt-cache topology updated: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [] 14:54:28,238 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,238 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,238 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating local topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending test-NodeA-55522#36 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=36], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,238 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t3) Installing new cache topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3398 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=36], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,238 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 used 3398 credits, 1850661 remaining 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#36 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#36 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3398 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=36], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t4) Updating stable topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#36 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#36 14:54:28,238 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=3398 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=36], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#36 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#36 14:54:28,238 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending test-NodeA-55522#37 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=37], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,238 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,238 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t3) Updating local topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3396 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=37], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 used 3396 credits, 1847265 remaining 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#37 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#37 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3396 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=37], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#37 14:54:28,238 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,238 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#37 14:54:28,238 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,238 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=3396 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=37], TP: [cluster_name=ISPN] 14:54:28,238 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,238 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 3398 credits, 1899475 remaining 14:54:28,238 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t3) Installing new cache topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,238 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,238 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t3) (isRunning=true) Installed new topology 13: CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling topology 13 is installed 14:54:28,238 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,238 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255}; old segments: {0-14 17-18 20-22 26-27 33-35 38-39 42-49 51-56 60-64 67-71 74-77 81-82 90-91 93-95 102-103 108-113 116-119 121-123 129-130 134-138 142-143 147-153 155-161 166-173 176-177 187-188 190-192 194-195 198-217 219-224 227-244 251-255} 14:54:28,238 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache opt-cache we have: added segments: {}; removed segments: {5 12 20 44 53-54 62-64 76-77 108-110 134-136 155 166-167 171 198 212 217 219 222-224 229 240-242} 14:54:28,238 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,238 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,238 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,238 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,238 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeA-55522 used 3398 credits, 1850661 remaining 14:54:28,238 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling transaction data received for topology 13 14:54:28,238 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t5) Updating local topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,238 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,238 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,238 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,239 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,239 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,239 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,239 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3396 credits, 1896079 remaining 14:54:28,239 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#37 14:54:28,239 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t5) Installing new cache topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,239 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#37 14:54:28,238 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,238 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,239 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:28,239 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:28,239 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Removing no longer owned entries for cache opt-cache 14:54:28,238 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,239 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 3398 credits, 1873341 remaining 14:54:28,238 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,239 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 3396 credits, 1869945 remaining 14:54:28,239 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 3396 credits, 1847265 remaining 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Topology changed, recalculating minTopologyId 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t3) Changing minimum topology ID from 12 to 13 14:54:28,239 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t3) (isRunning=true) Installed new topology 13: CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling topology 13 is installed 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: new segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251}; old segments: {9-17 19-25 27-33 36-38 40-41 50-51 53-54 56-74 77-80 83-89 92-107 114-120 124-128 130-136 139-141 144-151 154-155 158-165 167-172 174-176 178-186 189-190 193-194 196-197 204-215 218-220 224-226 231-243 245-251} 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: added segments: {}; removed segments: {9-11 14-15 21 32-33 36-38 58-60 71 85 97-100 114-117 124-125 130-131 139-141 144-147 169-170 178 183 204-206 209-210 213 220 231-234 237-239 243} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) On stable topology update. Pending txs: 0 14:54:28,239 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t5) (isRunning=true) Installed new topology 13: CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling topology 13 is installed 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling transaction data received for topology 13 14:54:28,239 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating stable topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Removing no longer owned entries for cache opt-cache 14:54:28,239 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 13: CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 13 is installed 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache opt-cache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {0-8 15-16 18-19 23-26 28-32 34-37 39-50 52-55 57-59 65-66 72-73 75-76 78-92 96-101 104-115 120-129 131-146 152-154 156-157 162-166 173-175 177-189 191-193 195-203 216-218 221-223 225-230 244-250 252-255} 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache opt-cache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache opt-cache we have: added segments: {}; removed segments: {0-1 4 23-26 34-35 43 52-53 72-73 78-79 84 87-88 96 104-106 120-123 126-129 133-135 152-154 156-157 179 182 185-187 199-203 216 228 255} 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) On stable topology update. Pending txs: 0 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling transaction data received for topology 13 14:54:28,239 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Topology changed, recalculating minTopologyId 14:54:28,239 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Changing minimum topology ID from 12 to 13 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 13 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], remote transactions: 0 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Removing no longer owned entries for cache opt-cache 14:54:28,239 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Removing no longer owned entries for cache opt-cache 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) On stable topology update. Pending txs: 0 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) Topology changed, recalculating minTopologyId 14:54:28,239 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t3) Updating stable topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) Changing minimum topology ID from 12 to 13 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Topology changed, recalculating minTopologyId 14:54:28,239 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Changing minimum topology ID from 12 to 13 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,239 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) On stable topology update. Pending txs: 0 14:54:28,239 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t5) Initial state transfer complete for cache opt-cache on node test-NodeD-25447 14:54:28,239 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+99, test-NodeB-18592: 63+117, test-NodeC-10992: 59+112, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=13} 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) On stable topology update. Pending txs: 0 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:28,240 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating stable topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,240 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t5) Updating stable topology for cache opt-cache: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) Check if topology CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,240 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) On stable topology update. Pending txs: 0 14:54:28,240 DEBUG [org.infinispan.cache.impl.CacheImpl] (TestNG) Started cache opt-cache on test-NodeD-25447 14:54:28,240 TRACE [org.infinispan.manager.DefaultCacheManager] (TestNG) Cache opt-cache started 14:54:28,242 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeA-55522: #13) 14:54:28,242 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=13, conn_id=1, ts=4, TP: [cluster_name=ISPN] 14:54:28,243 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeB-18592: #10) 14:54:28,243 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=5, TP: [cluster_name=ISPN] 14:54:28,243 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=13, conn_id=1, ts=4, TP: [cluster_name=ISPN] 14:54:28,243 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeD-25447: #5) 14:54:28,243 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeC-10992: #13, conn-id=1, ts=4) 14:54:28,243 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=5, conn_id=2, ts=6, TP: [cluster_name=ISPN] 14:54:28,243 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=5, TP: [cluster_name=ISPN] 14:54:28,243 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeC-10992: #10, conn-id=1, ts=5) 14:54:28,243 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=2, ts=6, TP: [cluster_name=ISPN] 14:54:28,243 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeC-10992: #5, conn-id=2, ts=6) 14:54:28,256 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeB-18592: #42) 14:54:28,256 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=42, ts=7, TP: [cluster_name=ISPN] 14:54:28,257 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeD-25447: #21) 14:54:28,257 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=21, ts=8, TP: [cluster_name=ISPN] 14:54:28,257 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeC-10992: #29) 14:54:28,257 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=29, ts=9, TP: [cluster_name=ISPN] 14:54:28,257 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=42, ts=7, TP: [cluster_name=ISPN] 14:54:28,257 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=21, ts=8, TP: [cluster_name=ISPN] 14:54:28,257 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeA-55522: #42, conn-id=0, ts=7) 14:54:28,257 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeA-55522: #21, conn-id=0, ts=8) 14:54:28,257 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=29, ts=9, TP: [cluster_name=ISPN] 14:54:28,257 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeA-55522: #29, conn-id=0, ts=9) 14:54:28,278 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeA-55522: #18) 14:54:28,278 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=18, ts=8, TP: [cluster_name=ISPN] 14:54:28,279 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeD-25447: #5) 14:54:28,279 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=9, TP: [cluster_name=ISPN] 14:54:28,279 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeC-10992: #10) 14:54:28,279 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=18, ts=8, TP: [cluster_name=ISPN] 14:54:28,279 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=10, TP: [cluster_name=ISPN] 14:54:28,279 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeB-18592: #18, conn-id=0, ts=8) 14:54:28,279 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=1, ts=9, TP: [cluster_name=ISPN] 14:54:28,279 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeB-18592: #5, conn-id=1, ts=9) 14:54:28,279 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=10, conn_id=1, ts=10, TP: [cluster_name=ISPN] 14:54:28,279 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeB-18592: #10, conn-id=1, ts=10) 14:54:28,287 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeA-55522: #13) 14:54:28,287 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=13, conn_id=2, ts=4, TP: [cluster_name=ISPN] 14:54:28,287 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeB-18592: #5) 14:54:28,288 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=5, conn_id=2, ts=5, TP: [cluster_name=ISPN] 14:54:28,288 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeC-10992: #5) 14:54:28,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=13, conn_id=2, ts=4, TP: [cluster_name=ISPN] 14:54:28,288 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=5, conn_id=2, ts=6, TP: [cluster_name=ISPN] 14:54:28,288 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeD-25447: #13, conn-id=2, ts=4) 14:54:28,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=2, ts=5, TP: [cluster_name=ISPN] 14:54:28,288 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeD-25447: #5, conn-id=2, ts=5) 14:54:28,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=5, conn_id=2, ts=6, TP: [cluster_name=ISPN] 14:54:28,288 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeD-25447: #5, conn-id=2, ts=6) 14:54:28,340 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeA-55522 finished state transfer, has topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,340 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeB-18592 finished state transfer, has topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,340 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeC-10992 finished state transfer, has topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,340 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeD-25447 finished state transfer, has topology CacheTopology{id=13, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,340 TRACE [org.infinispan.cache.impl.CacheImpl] (TestNG) Implicit transaction started! Transaction: EmbeddedTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E}, status=ACTIVE} 14:54:28,340 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Created a new local transaction: LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@d 14:54:28,340 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (TestNG) Invoked with command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@d228777] 14:54:28,340 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1}, origin null 14:54:28,340 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) Setting command topology to 13 14:54:28,340 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Checking availability for key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, status=AVAILABLE 14:54:28,340 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) Transaction.enlistResource(TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@d}) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E} 14:54:28,340 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XaResource.start() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E} 14:54:28,340 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (TestNG) start called on tx GlobalTx:test-NodeB-18592:13 14:54:28,340 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Exists in context? null 14:54:28,340 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Retrieved from container null 14:54:28,340 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,340 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Updated context entry null -> VersionedRepeatableReadEntry(36c50aba){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,340 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (TestNG) Invoking: PutKeyValueCommand 14:54:28,340 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (TestNG) The return value is null 14:54:28,340 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (TestNG) Adding version read SimpleClusteredVersion{topologyId=0, version=0} for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,340 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Transaction test-NodeB-18592:13 read MagicKey#k1{8/537A1109/107@test-NodeB-18592} with version SimpleClusteredVersion{topologyId=0, version=0} 14:54:28,340 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (TestNG) Release locks for keys=[]. owner=GlobalTx:test-NodeB-18592:13 14:54:28,340 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Clearing locked keys: [] 14:54:28,341 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) Adding modification PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}. Mod list is null 14:54:28,341 TRACE [org.infinispan.cache.impl.CacheImpl] (TestNG) Committing transaction as it was implicit: EmbeddedTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E}, status=ACTIVE} 14:54:28,341 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) Transaction.commit() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E} 14:54:28,341 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) runPrepare() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E} 14:54:28,341 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XAResource.end() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@d} 14:54:28,341 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (TestNG) end called on tx GlobalTx:test-NodeB-18592:13(opt-cache) 14:54:28,341 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XaResource.prepare() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@d} 14:54:28,341 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (TestNG) Sending prepare command through the chain: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} 14:54:28,341 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (TestNG) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@88dce19] 14:54:28,341 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'}, origin null 14:54:28,341 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) Setting command topology to 13 14:54:28,341 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (TestNG) Acquiring locks on MagicKey#k1{8/537A1109/107@test-NodeB-18592}. 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (TestNG) Await for pending transactions for transaction GlobalTx:test-NodeB-18592:13 using null 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (TestNG) Locking keys [MagicKey#k1{8/537A1109/107@test-NodeB-18592}], no need to check for pending locks. 14:54:28,341 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Registering locked key: MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (TestNG) Lock key=MagicKey#k1{8/537A1109/107@test-NodeB-18592} for owner=GlobalTx:test-NodeB-18592:13. timeout=10000 (MILLISECONDS) 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Acquire lock for GlobalTx:test-NodeB-18592:13. Timeout=10000 (MILLISECONDS) 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeB-18592:13} 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeB-18592:13}. Current=null 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeB-18592:13}) => true 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeB-18592:13}. WAITING => ACQUIRED 14:54:28,341 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeB-18592:13} successfully acquired the lock. 14:54:28,341 TRACE [org.infinispan.persistence.PersistenceUtil] (TestNG) Loaded null for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} from persistence. 14:54:28,341 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (TestNG) No entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} found in data container 14:54:28,341 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (TestNG) Comparing versions SimpleClusteredVersion{topologyId=0, version=0} and SimpleClusteredVersion{topologyId=0, version=0} for key MagicKey#k1{8/537A1109/107@test-NodeB-18592}: EQUAL 14:54:28,341 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (TestNG) Invoking: VersionedPrepareCommand 14:54:28,341 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (TestNG) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 14:54:28,341 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) Adding remote locks on [test-NodeB-18592, test-NodeC-10992]. Remote locks are null 14:54:28,341 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) getCommitNodes recipients=[test-NodeB-18592, test-NodeC-10992], currentTopologyId=13, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,341 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,341 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeB-18592 invoking VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,341 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeB-18592 sending request 21 to [test-NodeB-18592, test-NodeC-10992]: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} 14:54:28,341 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeB-18592 --> DATA(test-NodeC-10992: #11, conn_id=1) 14:54:28,341 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,341 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=443 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,341 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #11, conn_id=1) 14:54:28,341 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#11 14:54:28,342 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 21 from test-NodeB-18592: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} 14:54:28,342 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} [sender=test-NodeB-18592] 14:54:28,342 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeC-10992) Checking if transaction data was received for topology 13, current topology is 13 14:54:28,342 TRACE [org.infinispan.transaction.impl.TransactionTable] (jgroups-7,test-NodeC-10992) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:test-NodeB-18592:13, state=null} 14:54:28,342 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,342 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} 14:54:28,342 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeC-p146-t5) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@4418cb5 14:54:28,342 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t5) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@4418cb5] 14:54:28,342 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t5) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'}, origin test-NodeB-18592 14:54:28,342 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeC-p146-t5) Acquiring backup locks on MagicKey#k1{8/537A1109/107@test-NodeB-18592}. 14:54:28,342 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Exists in context? null 14:54:28,342 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Retrieved from container null 14:54:28,342 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,342 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-thread-test-NodeC-p146-t5) Adding key MagicKey#k1{8/537A1109/107@test-NodeB-18592} to tx GlobalTx:test-NodeB-18592:13 14:54:28,342 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Updated context entry null -> VersionedRepeatableReadEntry(b8dc83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,342 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t5) Invoking: PutKeyValueCommand 14:54:28,342 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t5) Invoking: VersionedPrepareCommand 14:54:28,342 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeC-p146-t5) Verifying transaction: alreadyCompleted=false 14:54:28,342 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeC-p146-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(b8dc83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeB-18592:13, state=null} 14:54:28,342 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 21 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,342 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeB-18592: #11, conn_id=1) 14:54:28,342 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,342 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,342 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #11, conn_id=1) 14:54:28,342 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#11 14:54:28,342 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received response for request 21 from test-NodeC-10992: SuccessfulResponse(null) 14:54:28,342 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-9,test-NodeB-18592) Response(s) to VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:28,342 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (jgroups-9,test-NodeB-18592) Current topology 13, command topology 13 14:54:28,342 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-9,test-NodeB-18592) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache'} with 4 handlers 14:54:28,343 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) runCommit(forceRollback=false) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E} 14:54:28,343 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XaResource.commit() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E}} LocalTransaction{remoteLockedNodes=[test-NodeB-18592, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@d} 14:54:28,343 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (TestNG) Committing transaction GlobalTx:test-NodeB-18592:13 14:54:28,343 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (TestNG) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=-1, updatedVersions=null} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@1972ba9f] 14:54:28,343 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=-1, updatedVersions=null}, origin null 14:54:28,343 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) Setting command topology to 13 14:54:28,343 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (TestNG) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 14:54:28,343 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) getCommitNodes recipients=[test-NodeB-18592, test-NodeC-10992], currentTopologyId=13, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,343 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,343 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeB-18592 invoking VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,343 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeB-18592: #11) 14:54:28,343 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=11, conn_id=1, ts=7, TP: [cluster_name=ISPN] 14:54:28,343 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeB-18592 sending request 22 to [test-NodeB-18592, test-NodeC-10992]: VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,343 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeB-18592 --> DATA(test-NodeC-10992: #12, conn_id=1) 14:54:28,343 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,343 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=11, conn_id=1, ts=7, TP: [cluster_name=ISPN] 14:54:28,343 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeC-10992: #11, conn-id=1, ts=7) 14:54:28,343 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=221 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,343 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #12, conn_id=1) 14:54:28,343 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#12 14:54:28,343 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 22 from test-NodeB-18592: VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,343 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute CacheRpcCommand: VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} [sender=test-NodeB-18592] 14:54:28,343 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeC-10992) Checking if transaction data was received for topology 13, current topology is 13 14:54:28,343 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,343 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,343 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-thread-test-NodeC-p146-t5) About to execute tx command VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,343 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t5) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@4418cb5] 14:54:28,343 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t5) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}}, origin test-NodeB-18592 14:54:28,343 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeC-p146-t5) Remote tx topology id 13 and command topology is 13 14:54:28,343 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t5) Invoking: VersionedCommitCommand 14:54:28,343 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-thread-test-NodeC-p146-t5) About to commit entry VersionedRepeatableReadEntry(b8dc83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,343 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeC-p146-t5) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=null, L1 invalidation=false 14:54:28,343 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeC-p146-t5) Committing key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:28,343 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeC-p146-t5) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, new value=init-value 14:54:28,343 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeC-p146-t5) Store MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} in container 14:54:28,343 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeC-p146-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(b8dc83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeB-18592:13, state=null} 14:54:28,343 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 22 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,343 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeB-18592: #12, conn_id=1) 14:54:28,343 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,343 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,344 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #12, conn_id=1) 14:54:28,344 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#12 14:54:28,344 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received response for request 22 from test-NodeC-10992: SuccessfulResponse(null) 14:54:28,344 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-9,test-NodeB-18592) Response(s) to VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:28,344 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (jgroups-9,test-NodeB-18592) Current topology 13, command topology 13 14:54:28,344 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-9,test-NodeB-18592) Resuming invocation of command VersionedCommitCommand{gtx=GlobalTx:test-NodeB-18592:13, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}} with 7 handlers 14:54:28,344 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-9,test-NodeB-18592) About to commit entry VersionedRepeatableReadEntry(36c50aba){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,344 TRACE [org.infinispan.statetransfer.CommitManager] (jgroups-9,test-NodeB-18592) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=null, L1 invalidation=false 14:54:28,344 TRACE [org.infinispan.statetransfer.CommitManager] (jgroups-9,test-NodeB-18592) Committing key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:28,344 TRACE [org.infinispan.container.DefaultDataContainer] (jgroups-9,test-NodeB-18592) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, new value=init-value 14:54:28,344 TRACE [org.infinispan.container.DefaultDataContainer] (jgroups-9,test-NodeB-18592) Store MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} in container 14:54:28,344 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (jgroups-9,test-NodeB-18592) Can release resources for transaction GlobalTx:test-NodeB-18592:13? true. Transaction info=null 14:54:28,344 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-9,test-NodeB-18592) Release locks for keys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}]. owner=GlobalTx:test-NodeB-18592:13 14:54:28,344 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Release lock for GlobalTx:test-NodeB-18592:13. 14:54:28,344 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeB-18592:13}. ACQUIRED => RELEASED 14:54:28,344 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeB-18592:13}? true 14:54:28,344 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeB-18592:13} 14:54:28,344 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeB-18592:13}, null) => true 14:54:28,344 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Try acquire. Next in queue=null. Current=null 14:54:28,344 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-9,test-NodeB-18592) Clearing locked keys: [MagicKey#k1{8/537A1109/107@test-NodeB-18592}] 14:54:28,344 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Removed LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000E,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000E}} LocalTransaction{remoteLockedNodes=[test-NodeB-18592, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@d from transaction table. 14:54:28,344 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Transaction GlobalTx:test-NodeB-18592:13 has completed, notifying listening threads. 14:54:28,344 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Committed in onePhase? false isOptimistic? true 14:54:28,344 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Can release resources for transaction GlobalTx:test-NodeB-18592:13? true. Transaction info=null 14:54:28,344 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) getCommitNodes recipients=[test-NodeB-18592, test-NodeC-10992], currentTopologyId=13, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,344 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,344 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) About to invoke tx completion notification on commitNodes: [test-NodeB-18592, test-NodeC-10992] 14:54:28,344 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeB-18592 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:test-NodeB-18592:13, cacheName=opt-cache} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 14:54:28,344 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) Topology id missing on command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:test-NodeB-18592:13, cacheName=opt-cache} , setting it to 13 14:54:28,344 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeB-18592 sending command to [test-NodeB-18592, test-NodeC-10992]: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeB-18592:13, cacheName=opt-cache} 14:54:28,344 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeB-18592 --> DATA(test-NodeC-10992: #13, conn_id=1) 14:54:28,344 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,344 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeB-18592:13, cacheName=opt-cache} is {} 14:54:28,344 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,344 TRACE [org.infinispan.cache.impl.CacheImpl] (TestNG) Implicit transaction started! Transaction: EmbeddedTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F}, status=ACTIVE} 14:54:28,344 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #13, conn_id=1) 14:54:28,345 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#13 14:54:28,345 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Created a new local transaction: LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@e 14:54:28,345 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeB-18592: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeB-18592:13, cacheName=opt-cache} 14:54:28,345 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeB-18592:13, cacheName=opt-cache} [sender=test-NodeB-18592] 14:54:28,345 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeC-10992) Checking if transaction data was received for topology 13, current topology is 13 14:54:28,345 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,345 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeB-18592:13, cacheName=opt-cache} 14:54:28,345 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeC-p146-t5) Processing completed transaction GlobalTx:test-NodeB-18592:13 14:54:28,345 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (TestNG) Invoked with command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@7f6952ae] 14:54:28,345 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1}, origin null 14:54:28,345 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) Setting command topology to 13 14:54:28,345 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t5) Removed remote transaction GlobalTx:test-NodeB-18592:13 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(b8dc83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeB-18592:13, state=null} 14:54:28,345 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Checking availability for key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, status=AVAILABLE 14:54:28,345 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) Transaction.enlistResource(TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@e}) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F} 14:54:28,345 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t5) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(b8dc83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeB-18592:13, state=null} from transaction table. 14:54:28,345 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XaResource.start() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F} 14:54:28,345 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeC-p146-t5) Transaction GlobalTx:test-NodeB-18592:13 has completed, notifying listening threads. 14:54:28,345 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (TestNG) start called on tx GlobalTx:test-NodeC-10992:14 14:54:28,345 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t5) Marking transaction GlobalTx:test-NodeB-18592:13 as completed 14:54:28,345 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Exists in context? null 14:54:28,345 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Retrieved from container null 14:54:28,345 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeC-p146-t5) Invoking forward of TxCompletionNotification for transaction GlobalTx:test-NodeB-18592:13. Affected keys: [MagicKey#k1{8/537A1109/107@test-NodeB-18592}] 14:54:28,345 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-thread-test-NodeC-p146-t5) CommandTopologyId=13, localTopologyId=13 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeC-p146-t5) Release locks for keys=[]. owner=GlobalTx:test-NodeB-18592:13 14:54:28,345 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,345 TRACE [org.infinispan.container.EntryFactoryImpl] (TestNG) Updated context entry null -> VersionedRepeatableReadEntry(7c1f039){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,345 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (TestNG) Invoking: PutKeyValueCommand 14:54:28,345 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (TestNG) The return value is null 14:54:28,345 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (TestNG) Adding version read SimpleClusteredVersion{topologyId=0, version=0} for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,345 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Transaction test-NodeC-10992:14 read MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} with version SimpleClusteredVersion{topologyId=0, version=0} 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (TestNG) Release locks for keys=[]. owner=GlobalTx:test-NodeC-10992:14 14:54:28,345 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Clearing locked keys: [] 14:54:28,345 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) Adding modification PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}. Mod list is null 14:54:28,345 TRACE [org.infinispan.cache.impl.CacheImpl] (TestNG) Committing transaction as it was implicit: EmbeddedTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F}, status=ACTIVE} 14:54:28,345 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) Transaction.commit() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F} 14:54:28,345 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) runPrepare() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F} 14:54:28,345 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XAResource.end() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@e} 14:54:28,345 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (TestNG) end called on tx GlobalTx:test-NodeC-10992:14(opt-cache) 14:54:28,345 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XaResource.prepare() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@e} 14:54:28,345 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (TestNG) Sending prepare command through the chain: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} 14:54:28,345 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (TestNG) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@675dfc21] 14:54:28,345 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'}, origin null 14:54:28,345 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) Setting command topology to 13 14:54:28,345 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (TestNG) Acquiring locks on MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (TestNG) Await for pending transactions for transaction GlobalTx:test-NodeC-10992:14 using null 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (TestNG) Locking keys [MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], no need to check for pending locks. 14:54:28,345 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Registering locked key: MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (TestNG) Lock key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} for owner=GlobalTx:test-NodeC-10992:14. timeout=10000 (MILLISECONDS) 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Acquire lock for GlobalTx:test-NodeC-10992:14. Timeout=10000 (MILLISECONDS) 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeC-10992:14} 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeC-10992:14}. Current=null 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeC-10992:14}) => true 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeC-10992:14}. WAITING => ACQUIRED 14:54:28,345 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (TestNG) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeC-10992:14} successfully acquired the lock. 14:54:28,345 TRACE [org.infinispan.persistence.PersistenceUtil] (TestNG) Loaded null for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} from persistence. 14:54:28,345 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (TestNG) No entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} found in data container 14:54:28,346 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (TestNG) Comparing versions SimpleClusteredVersion{topologyId=0, version=0} and SimpleClusteredVersion{topologyId=0, version=0} for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}: EQUAL 14:54:28,346 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (TestNG) Invoking: VersionedPrepareCommand 14:54:28,346 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (TestNG) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 14:54:28,346 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) Adding remote locks on [test-NodeC-10992, test-NodeB-18592]. Remote locks are null 14:54:28,346 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) getCommitNodes recipients=[test-NodeC-10992, test-NodeB-18592], currentTopologyId=13, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,346 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,346 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeC-10992 invoking VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,346 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeC-10992 sending request 18 to [test-NodeB-18592, test-NodeC-10992]: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} 14:54:28,346 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeC-10992 --> DATA(test-NodeB-18592: #13, conn_id=1) 14:54:28,346 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,346 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=443 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,346 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #13, conn_id=1) 14:54:28,346 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#13 14:54:28,346 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 18 from test-NodeC-10992: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} 14:54:28,346 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} [sender=test-NodeC-10992] 14:54:28,346 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-9,test-NodeB-18592) Checking if transaction data was received for topology 13, current topology is 13 14:54:28,346 TRACE [org.infinispan.transaction.impl.TransactionTable] (jgroups-9,test-NodeB-18592) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:test-NodeC-10992:14, state=null} 14:54:28,346 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,346 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} 14:54:28,346 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeB-p138-t6) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@489bd655 14:54:28,347 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeB-p138-t6) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@489bd655] 14:54:28,347 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeB-p138-t6) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'}, origin test-NodeC-10992 14:54:28,347 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeB-p138-t6) Acquiring backup locks on MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. 14:54:28,347 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Exists in context? null 14:54:28,347 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Retrieved from container null 14:54:28,347 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,347 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-thread-test-NodeB-p138-t6) Adding key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} to tx GlobalTx:test-NodeC-10992:14 14:54:28,347 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Updated context entry null -> VersionedRepeatableReadEntry(44d5e6e6){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,347 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t6) Invoking: PutKeyValueCommand 14:54:28,347 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t6) Invoking: VersionedPrepareCommand 14:54:28,347 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeB-p138-t6) Verifying transaction: alreadyCompleted=false 14:54:28,347 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeB-p138-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(44d5e6e6){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeC-10992:14, state=null} 14:54:28,347 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 18 to test-NodeC-10992: SuccessfulResponse(null) 14:54:28,347 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeC-10992: #14, conn_id=1) 14:54:28,347 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,347 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,347 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #14, conn_id=1) 14:54:28,347 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#14 14:54:28,347 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received response for request 18 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,347 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeC-10992) Response(s) to VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,347 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (jgroups-7,test-NodeC-10992) Current topology 13, command topology 13 14:54:28,347 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-7,test-NodeC-10992) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=0, version=0}}, gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache'} with 4 handlers 14:54:28,347 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) runCommit(forceRollback=false) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F} 14:54:28,347 TRACE [org.infinispan.commons.tx.TransactionImpl] (TestNG) XaResource.commit() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F}} LocalTransaction{remoteLockedNodes=[test-NodeB-18592, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@e} 14:54:28,347 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (TestNG) Committing transaction GlobalTx:test-NodeC-10992:14 14:54:28,347 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (TestNG) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=-1, updatedVersions=null} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@56f6a423] 14:54:28,347 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=-1, updatedVersions=null}, origin null 14:54:28,347 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (TestNG) Setting command topology to 13 14:54:28,347 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (TestNG) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 14:54:28,348 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) getCommitNodes recipients=[test-NodeC-10992, test-NodeB-18592], currentTopologyId=13, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,348 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,348 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeC-10992 invoking VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,348 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeC-10992 sending request 19 to [test-NodeB-18592, test-NodeC-10992]: VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,348 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeC-10992 --> DATA(test-NodeB-18592: #14, conn_id=1) 14:54:28,348 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,348 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=221 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,348 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #14, conn_id=1) 14:54:28,348 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#14 14:54:28,348 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 19 from test-NodeC-10992: VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,348 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} [sender=test-NodeC-10992] 14:54:28,348 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-9,test-NodeB-18592) Checking if transaction data was received for topology 13, current topology is 13 14:54:28,348 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,348 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,348 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-thread-test-NodeB-p138-t6) About to execute tx command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,348 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeB-p138-t6) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@489bd655] 14:54:28,348 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeB-p138-t6) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}}, origin test-NodeC-10992 14:54:28,348 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeB-p138-t6) Remote tx topology id 13 and command topology is 13 14:54:28,348 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t6) Invoking: VersionedCommitCommand 14:54:28,348 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-thread-test-NodeB-p138-t6) About to commit entry VersionedRepeatableReadEntry(44d5e6e6){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,348 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeB-p138-t6) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=null, L1 invalidation=false 14:54:28,348 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeB-p138-t6) Committing key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:28,349 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeB-p138-t6) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, new value=init-value 14:54:28,349 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeB-p138-t6) Store MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} in container 14:54:28,349 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeB-p138-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(44d5e6e6){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeC-10992:14, state=null} 14:54:28,349 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 19 to test-NodeC-10992: SuccessfulResponse(null) 14:54:28,349 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeC-10992: #15, conn_id=1) 14:54:28,349 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,349 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,349 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #15, conn_id=1) 14:54:28,349 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#15 14:54:28,349 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received response for request 19 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,349 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeC-10992) Response(s) to VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,349 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (jgroups-7,test-NodeC-10992) Current topology 13, command topology 13 14:54:28,349 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-7,test-NodeC-10992) Resuming invocation of command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:14, cacheName='opt-cache', topologyId=13, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}} with 7 handlers 14:54:28,349 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-7,test-NodeC-10992) About to commit entry VersionedRepeatableReadEntry(7c1f039){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,349 TRACE [org.infinispan.statetransfer.CommitManager] (jgroups-7,test-NodeC-10992) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=null, L1 invalidation=false 14:54:28,349 TRACE [org.infinispan.statetransfer.CommitManager] (jgroups-7,test-NodeC-10992) Committing key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:28,349 TRACE [org.infinispan.container.DefaultDataContainer] (jgroups-7,test-NodeC-10992) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, new value=init-value 14:54:28,349 TRACE [org.infinispan.container.DefaultDataContainer] (jgroups-7,test-NodeC-10992) Store MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} in container 14:54:28,349 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (jgroups-7,test-NodeC-10992) Can release resources for transaction GlobalTx:test-NodeC-10992:14? true. Transaction info=null 14:54:28,349 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-7,test-NodeC-10992) Release locks for keys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]. owner=GlobalTx:test-NodeC-10992:14 14:54:28,350 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Release lock for GlobalTx:test-NodeC-10992:14. 14:54:28,350 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeC-10992:14}. ACQUIRED => RELEASED 14:54:28,350 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeC-10992:14}? true 14:54:28,350 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeC-10992:14} 14:54:28,350 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeC-10992:14}, null) => true 14:54:28,350 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Try acquire. Next in queue=null. Current=null 14:54:28,350 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-7,test-NodeC-10992) Clearing locked keys: [MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}] 14:54:28,350 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Removed LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D000000000000000F,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D000000000000000F}} LocalTransaction{remoteLockedNodes=[test-NodeB-18592, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@e from transaction table. 14:54:28,350 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (TestNG) Transaction GlobalTx:test-NodeC-10992:14 has completed, notifying listening threads. 14:54:28,350 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) Committed in onePhase? false isOptimistic? true 14:54:28,350 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (TestNG) Can release resources for transaction GlobalTx:test-NodeC-10992:14? true. Transaction info=null 14:54:28,350 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) getCommitNodes recipients=[test-NodeC-10992, test-NodeB-18592], currentTopologyId=13, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,350 TRACE [org.infinispan.transaction.impl.LocalTransaction] (TestNG) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,350 TRACE [org.infinispan.transaction.impl.TransactionTable] (TestNG) About to invoke tx completion notification on commitNodes: [test-NodeB-18592, test-NodeC-10992] 14:54:28,350 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) test-NodeC-10992 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:test-NodeC-10992:14, cacheName=opt-cache} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 14:54:28,350 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) Topology id missing on command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:test-NodeC-10992:14, cacheName=opt-cache} , setting it to 13 14:54:28,350 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) test-NodeC-10992 sending command to [test-NodeB-18592, test-NodeC-10992]: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeC-10992:14, cacheName=opt-cache} 14:54:28,350 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeC-10992 --> DATA(test-NodeB-18592: #15, conn_id=1) 14:54:28,350 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,350 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (TestNG) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeC-10992:14, cacheName=opt-cache} is {} 14:54:28,350 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,350 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #15, conn_id=1) 14:54:28,350 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#15 14:54:28,350 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeC-10992:14, cacheName=opt-cache} 14:54:28,350 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeC-10992:14, cacheName=opt-cache} [sender=test-NodeC-10992] 14:54:28,350 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-9,test-NodeB-18592) Checking if transaction data was received for topology 13, current topology is 13 14:54:28,350 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,350 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=13, gtx=GlobalTx:test-NodeC-10992:14, cacheName=opt-cache} 14:54:28,351 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeB-p138-t6) Processing completed transaction GlobalTx:test-NodeC-10992:14 14:54:28,351 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t6) Removed remote transaction GlobalTx:test-NodeC-10992:14 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(44d5e6e6){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeC-10992:14, state=null} 14:54:28,351 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t6) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(44d5e6e6){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeC-10992:14, state=null} from transaction table. 14:54:28,351 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeB-p138-t6) Transaction GlobalTx:test-NodeC-10992:14 has completed, notifying listening threads. 14:54:28,351 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t6) Marking transaction GlobalTx:test-NodeC-10992:14 as completed 14:54:28,351 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeB-p138-t6) Invoking forward of TxCompletionNotification for transaction GlobalTx:test-NodeC-10992:14. Affected keys: [MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}] 14:54:28,351 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-thread-test-NodeB-p138-t6) CommandTopologyId=13, localTopologyId=13 14:54:28,351 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeB-p138-t6) Release locks for keys=[]. owner=GlobalTx:test-NodeC-10992:14 14:54:28,351 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Started fork callable.. 14:54:28,351 TRACE [org.infinispan.transaction.impl.TransactionTable] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Created a new local transaction: LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f 14:54:28,351 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Invoked with command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@1451f862] 14:54:28,351 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1}, origin null 14:54:28,351 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Setting command topology to 13 14:54:28,351 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Checking availability for key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, status=AVAILABLE 14:54:28,351 TRACE [org.infinispan.commons.tx.TransactionImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Transaction.enlistResource(TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f}) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010} 14:54:28,351 TRACE [org.infinispan.commons.tx.TransactionImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) XaResource.start() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010} 14:54:28,351 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) start called on tx GlobalTx:test-NodeA-55522:15 14:54:28,351 TRACE [org.infinispan.container.EntryFactoryImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Exists in context? null 14:54:28,351 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Current topology 13, command topology 13 14:54:28,351 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Perform remote get for key MagicKey#k1{8/537A1109/107@test-NodeB-18592}. currentTopologyId=13, owners=[test-NodeB-18592, test-NodeC-10992] 14:54:28,351 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 invoking ClusteredGetCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[], topologyId=13} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=org.infinispan.interceptors.impl.BaseRpcInterceptor$1@6fe63c74, responseMode=WAIT_FOR_VALID_RESPONSE} 14:54:28,352 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 sending request 12 to test-NodeB-18592: ClusteredGetCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[], topologyId=13} 14:54:28,352 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeB-18592: #19, conn_id=0) 14:54:28,352 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 14:54:28,352 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=184 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=19, TP: [cluster_name=ISPN] 14:54:28,352 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #19, conn_id=0) 14:54:28,352 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#19 14:54:28,352 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 12 from test-NodeA-55522: ClusteredGetCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[], topologyId=13} 14:54:28,352 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: ClusteredGetCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[], topologyId=13} [sender=test-NodeA-55522] 14:54:28,352 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-9,test-NodeB-18592) [Notifier] Checking command ClusteredGetCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[], topologyId=13}. 14:54:28,352 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Calling perform() on ClusteredGetCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[], topologyId=13} 14:54:28,352 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (jgroups-9,test-NodeB-18592) Invoked with command GetCacheEntryCommand {key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[SKIP_REMOTE_LOOKUP]} and InvocationContext [SingleKeyNonTxInvocationContext{isLocked=false, key=null, cacheEntry=null, origin=test-NodeA-55522, lockOwner=null}] 14:54:28,352 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-9,test-NodeB-18592) Exists in context? null 14:54:28,352 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-9,test-NodeB-18592) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,352 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-9,test-NodeB-18592) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,352 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-9,test-NodeB-18592) Wrap MagicKey#k1{8/537A1109/107@test-NodeB-18592} for read. Entry=VersionedRepeatableReadEntry(86837a8){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,352 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (jgroups-9,test-NodeB-18592) Invoking: GetCacheEntryCommand 14:54:28,352 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (jgroups-9,test-NodeB-18592) Checking availability for key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, status=AVAILABLE 14:54:28,352 TRACE [org.infinispan.commands.remote.ClusteredGetCommand] (jgroups-9,test-NodeB-18592) Return value for key=MagicKey#k1{8/537A1109/107@test-NodeB-18592} is VersionedRepeatableReadEntry(59732fe7){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,352 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 sending response for request 12 to test-NodeA-55522: SuccessfulResponse(MetadataImmortalCacheValue {value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}) 14:54:28,352 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 --> DATA(test-NodeA-55522: #43, conn_id=0) 14:54:28,352 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:28,352 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=51 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=12, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:28,352 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #43, conn_id=0) 14:54:28,352 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#43 14:54:28,352 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 12 from test-NodeB-18592: SuccessfulResponse(MetadataImmortalCacheValue {value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}) 14:54:28,353 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to ClusteredGetCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, flags=[], topologyId=13} is {test-NodeB-18592=SuccessfulResponse(MetadataImmortalCacheValue {value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}})} 14:54:28,353 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-15,test-NodeA-55522) Exists in context? null 14:54:28,353 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-15,test-NodeA-55522) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,353 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-15,test-NodeA-55522) Updated context entry null -> VersionedRepeatableReadEntry(3319e833){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,353 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13} with 7 handlers 14:54:28,353 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (jgroups-15,test-NodeA-55522) Invoking: PutKeyValueCommand 14:54:28,353 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-15,test-NodeA-55522) The return value is init-value 14:54:28,353 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-15,test-NodeA-55522) Adding version read SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,353 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-15,test-NodeA-55522) Transaction test-NodeA-55522:15 read MagicKey#k1{8/537A1109/107@test-NodeB-18592} with version SimpleClusteredVersion{topologyId=13, version=1} 14:54:28,353 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-15,test-NodeA-55522) Release locks for keys=[]. owner=GlobalTx:test-NodeA-55522:15 14:54:28,353 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-15,test-NodeA-55522) Clearing locked keys: [] 14:54:28,353 TRACE [org.infinispan.transaction.impl.LocalTransaction] (jgroups-15,test-NodeA-55522) Adding modification PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}. Mod list is null 14:54:28,353 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Invoked with command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@1a6ef300] 14:54:28,353 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=-1}, origin null 14:54:28,353 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Setting command topology to 13 14:54:28,353 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Checking availability for key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, status=AVAILABLE 14:54:28,353 TRACE [org.infinispan.container.EntryFactoryImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Exists in context? null 14:54:28,353 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Current topology 13, command topology 13 14:54:28,353 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Perform remote get for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. currentTopologyId=13, owners=[test-NodeC-10992, test-NodeB-18592] 14:54:28,353 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 invoking ClusteredGetCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[], topologyId=13} to recipient list [test-NodeC-10992, test-NodeB-18592] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=org.infinispan.interceptors.impl.BaseRpcInterceptor$1@6fe63c74, responseMode=WAIT_FOR_VALID_RESPONSE} 14:54:28,353 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 sending request 13 to test-NodeC-10992: ClusteredGetCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[], topologyId=13} 14:54:28,353 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeC-10992: #14, conn_id=1) 14:54:28,353 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,354 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=184 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,354 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #14, conn_id=1) 14:54:28,354 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#14 14:54:28,354 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 13 from test-NodeA-55522: ClusteredGetCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[], topologyId=13} 14:54:28,354 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute CacheRpcCommand: ClusteredGetCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[], topologyId=13} [sender=test-NodeA-55522] 14:54:28,354 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeC-10992) [Blocking] Checking command ClusteredGetCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[], topologyId=13}. 14:54:28,354 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Calling perform() on ClusteredGetCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[], topologyId=13} 14:54:28,354 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (jgroups-7,test-NodeC-10992) Invoked with command GetCacheEntryCommand {key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[SKIP_REMOTE_LOOKUP]} and InvocationContext [SingleKeyNonTxInvocationContext{isLocked=false, key=null, cacheEntry=null, origin=test-NodeA-55522, lockOwner=null}] 14:54:28,354 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-7,test-NodeC-10992) Exists in context? null 14:54:28,354 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-7,test-NodeC-10992) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,354 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-7,test-NodeC-10992) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,354 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-7,test-NodeC-10992) Wrap MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} for read. Entry=VersionedRepeatableReadEntry(4e4d00b4){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,354 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (jgroups-7,test-NodeC-10992) Invoking: GetCacheEntryCommand 14:54:28,354 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (jgroups-7,test-NodeC-10992) Checking availability for key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, status=AVAILABLE 14:54:28,354 TRACE [org.infinispan.commands.remote.ClusteredGetCommand] (jgroups-7,test-NodeC-10992) Return value for key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} is VersionedRepeatableReadEntry(7f96facf){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,354 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 sending response for request 13 to test-NodeA-55522: SuccessfulResponse(MetadataImmortalCacheValue {value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}) 14:54:28,354 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 --> DATA(test-NodeA-55522: #30, conn_id=0) 14:54:28,354 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,354 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=51 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=13, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,354 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #30, conn_id=0) 14:54:28,354 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#30 14:54:28,354 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 13 from test-NodeC-10992: SuccessfulResponse(MetadataImmortalCacheValue {value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}) 14:54:28,354 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to ClusteredGetCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, flags=[], topologyId=13} is {test-NodeC-10992=SuccessfulResponse(MetadataImmortalCacheValue {value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}})} 14:54:28,354 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-15,test-NodeA-55522) Exists in context? null 14:54:28,354 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-15,test-NodeA-55522) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,354 TRACE [org.infinispan.container.EntryFactoryImpl] (jgroups-15,test-NodeA-55522) Updated context entry null -> VersionedRepeatableReadEntry(3dde1020){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,355 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13} with 7 handlers 14:54:28,355 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (jgroups-15,test-NodeA-55522) Invoking: PutKeyValueCommand 14:54:28,355 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-15,test-NodeA-55522) The return value is init-value 14:54:28,355 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-15,test-NodeA-55522) Adding version read SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,355 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-15,test-NodeA-55522) Transaction test-NodeA-55522:15 read MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} with version SimpleClusteredVersion{topologyId=13, version=1} 14:54:28,355 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-15,test-NodeA-55522) Release locks for keys=[]. owner=GlobalTx:test-NodeA-55522:15 14:54:28,355 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-15,test-NodeA-55522) Clearing locked keys: [] 14:54:28,355 TRACE [org.infinispan.transaction.impl.LocalTransaction] (jgroups-15,test-NodeA-55522) Adding modification PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}. Mod list is [PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}] 14:54:28,355 TRACE [org.infinispan.commons.tx.TransactionImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) runPrepare() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010} 14:54:28,355 TRACE [org.infinispan.commons.tx.TransactionImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) XAResource.end() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f} 14:54:28,355 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) end called on tx GlobalTx:test-NodeA-55522:15(opt-cache) 14:54:28,355 TRACE [org.infinispan.commons.tx.TransactionImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) XaResource.prepare() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f} 14:54:28,355 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Sending prepare command through the chain: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,355 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@1ad8d136] 14:54:28,355 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}, origin null 14:54:28,355 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Setting command topology to 13 14:54:28,355 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Invoking: VersionedPrepareCommand 14:54:28,355 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 14:54:28,355 TRACE [org.infinispan.transaction.impl.LocalTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Adding remote locks on [test-NodeC-10992, test-NodeB-18592]. Remote locks are null 14:54:28,355 TRACE [org.infinispan.transaction.impl.LocalTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) getCommitNodes recipients=[test-NodeC-10992, test-NodeB-18592], currentTopologyId=13, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,355 TRACE [org.infinispan.transaction.impl.LocalTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,355 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 invoking VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,355 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 sending request 14 to [test-NodeB-18592, test-NodeC-10992]: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,355 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeB-18592: #20, conn_id=0) 14:54:28,355 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 14:54:28,355 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeC-10992: #15, conn_id=1) 14:54:28,355 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,355 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=20, TP: [cluster_name=ISPN] 14:54:28,355 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #20, conn_id=0) 14:54:28,355 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#20 14:54:28,355 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,355 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #15, conn_id=1) 14:54:28,355 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#15 14:54:28,356 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 14 from test-NodeA-55522: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,356 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 14 from test-NodeA-55522: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,356 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} [sender=test-NodeA-55522] 14:54:28,356 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} [sender=test-NodeA-55522] 14:54:28,356 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-9,test-NodeB-18592) [Notifier] Checking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:28,356 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeC-10992) [Blocking] Checking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:28,356 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-9,test-NodeB-18592) [Notifier] Notifying command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:28,356 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeC-10992) [Blocking] Blocking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,356 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-9,test-NodeB-18592) Checking if transaction data was received for topology 13, current topology is 13 14:54:28,356 DEBUG [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Splitting cluster isolating a primary owner. 14:54:28,356 TRACE [org.infinispan.transaction.impl.TransactionTable] (jgroups-9,test-NodeB-18592) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-9,test-NodeB-18592) Checking for pending locks and then locking key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,356 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Partition forming 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-9,test-NodeB-18592) No transactions pending for Transaction GlobalTx:test-NodeA-55522:15 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-9,test-NodeB-18592) Stored PendingLock is NO_OP 14:54:28,356 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Before installing new view... 14:54:28,356 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeC-10992: installing view [test-NodeC-10992|26] (1) [test-NodeC-10992] 14:54:28,356 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-9,test-NodeB-18592) Registering locked key: MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-9,test-NodeB-18592) Lock key=MagicKey#k1{8/537A1109/107@test-NodeB-18592} for owner=GlobalTx:test-NodeA-55522:15. timeout=10000 (MILLISECONDS) 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:28,356 DEBUG [org.jgroups.protocols.pbcast.STABLE] (TestNG) resuming message garbage collection 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15}. Current=null 14:54:28,356 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeC-10992: closing connections of non members [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15}) => true 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15}. WAITING => ACQUIRED 14:54:28,356 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (TestNG) test-NodeC-10992: removed test-NodeA-55522 from xmit_table (not member anymore) 14:54:28,356 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-9,test-NodeB-18592) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} successfully acquired the lock. 14:54:28,356 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (TestNG) test-NodeC-10992: removed test-NodeB-18592 from xmit_table (not member anymore) 14:54:28,356 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (TestNG) test-NodeC-10992: removed test-NodeD-25447 from xmit_table (not member anymore) 14:54:28,356 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,356 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,357 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeB-p138-t6) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab 14:54:28,357 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeB-18592: #43) 14:54:28,357 DEBUG [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-8,test-NodeC-10992) test-NodeC-10992: socket to null was closed gracefully 14:54:28,357 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeB-p138-t6) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:28,357 DEBUG [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-8,test-NodeC-10992) test-NodeC-10992: ping_dest is null, pingable_mbrs=[test-NodeC-10992] 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=43, ts=10, TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-8,test-NodeC-10992) test-NodeC-10992: pinger thread terminated 14:54:28,357 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeC-10992: #30) 14:54:28,357 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeB-p138-t6) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}, origin test-NodeA-55522 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=30, ts=11, TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeB-p138-t6) Acquiring backup locks on MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=43, ts=10, TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=37], TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeA-55522: #43, conn-id=0, ts=10) 14:54:28,357 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeB-p138-t6) Acquiring locks on MagicKey#k1{8/537A1109/107@test-NodeB-18592}. 14:54:28,357 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (remote-thread-test-NodeB-p138-t6) Await for pending transactions for transaction GlobalTx:test-NodeA-55522:15 using NO_OP 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=30, ts=11, TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeB-p138-t6) Registering locked key: MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=37], TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=37], TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.jgroups.protocols.DISCARD] (jgroups-10,test-NodeC-10992) null: dropping message from test-NodeA-55522 14:54:28,357 TRACE [org.jgroups.protocols.DISCARD] (jgroups-6,test-NodeC-10992) null: dropping message from test-NodeA-55522 14:54:28,357 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeB-p138-t6) Lock key=MagicKey#k1{8/537A1109/107@test-NodeB-18592} for owner=GlobalTx:test-NodeA-55522:15. timeout=10000 (MILLISECONDS) 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=37], TP: [cluster_name=ISPN] 14:54:28,357 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t6) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:28,357 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t6) Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [127.0.0.1:7902]-13,test-NodeD-25447) 127.0.0.1:7903: removed connection to 127.0.0.1:7902 14:54:28,357 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Exists in context? null 14:54:28,358 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,358 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view [test-NodeC-10992|26] (1) [test-NodeC-10992] 14:54:28,357 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [null]-12,test-NodeB-18592) 127.0.0.1:7901: removed connection to 127.0.0.1:7902 14:54:28,358 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,358 TRACE [org.jgroups.protocols.TCP_NIO2] (NioConnection.Reader [null]-11,test-NodeA-55522) 127.0.0.1:7900: removed connection to 127.0.0.1:7902 14:54:28,358 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-thread-test-NodeB-p138-t6) Adding key MagicKey#k1{8/537A1109/107@test-NodeB-18592} to tx GlobalTx:test-NodeA-55522:15 14:54:28,358 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeC-10992] 14:54:28,358 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Updated context entry null -> VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,358 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t6) Invoking: PutKeyValueCommand 14:54:28,358 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000094: Received new cluster view for channel ISPN: [test-NodeC-10992|26] (1) [test-NodeC-10992] 14:54:28,358 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Exists in context? null 14:54:28,358 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,358 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [], Left: [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,358 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,358 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-thread-test-NodeB-p138-t6) Adding key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} to tx GlobalTx:test-NodeA-55522:15 14:54:28,358 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,358 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t6) Updated context entry null -> VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,358 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t6) Invoking: PutKeyValueCommand 14:54:28,358 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@2e62fffb passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} 14:54:28,358 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t6) Invoking: VersionedPrepareCommand 14:54:28,358 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Received new cluster view: 26, isCoordinator = true, old status = REGULAR_MEMBER 14:54:28,358 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (remote-thread-test-NodeB-p138-t6) Comparing versions SimpleClusteredVersion{topologyId=13, version=1} and SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k1{8/537A1109/107@test-NodeB-18592}: EQUAL 14:54:28,358 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Recovering cluster status for view 26 14:54:28,358 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100001: Node test-NodeA-55522 left the cluster 14:54:28,358 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t1) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=test-NodeC-10992, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=26} 14:54:28,358 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeB-p138-t6) Verifying transaction: alreadyCompleted=false 14:54:28,358 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=test-NodeC-10992, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=26} 14:54:28,358 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100001: Node test-NodeB-18592 left the cluster 14:54:28,358 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100001: Node test-NodeD-25447 left the cluster 14:54:28,358 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Sending cluster status response for view 26 14:54:28,358 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@f67d1bb passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} 14:54:28,358 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Got 1 status responses. members are [test-NodeC-10992] 14:54:28,358 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} and result was 7318353689444352 14:54:28,358 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@1f06d462 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} 14:54:28,358 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeB-p138-t6) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,358 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} and result was 7318353689444352 14:54:28,358 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} 14:54:28,358 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 14 to test-NodeA-55522: SuccessfulResponse({MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=2}}) 14:54:28,358 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@5e42e628 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} 14:54:28,358 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeC-10992], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeC-10992, viewId=26, subgroupsMerged=null, mergeView=false} and result was 7318353689444352 14:54:28,358 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Cache opt-cache initialized. Persisted state? false 14:54:28,358 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,358 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeC-p147-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992], remote transactions: 0 14:54:28,358 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Cache ___defaultcache initialized. Persisted state? false 14:54:28,358 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeC-p147-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,358 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) New views installed 14:54:28,358 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Recovered 1 partition(s) for cache ___defaultcache: [CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}] 14:54:28,358 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Recovered 1 partition(s) for cache opt-cache: [CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}] 14:54:28,358 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #44, conn_id=0) 14:54:28,358 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Added joiner test-NodeC-10992 to cache ___defaultcache with persistent uuid a4bb04c4-2aa5-469c-b481-a543584bde06: members = [test-NodeC-10992], joiners = [test-NodeC-10992] 14:54:28,358 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Added joiner test-NodeC-10992 to cache opt-cache with persistent uuid a4bb04c4-2aa5-469c-b481-a543584bde06: members = [test-NodeC-10992], joiners = [test-NodeC-10992] 14:54:28,358 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 14:54:28,358 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Partition forming 14:54:28,358 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t3) Max stable partition topology: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,358 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t2) Max stable partition topology: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,358 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Before installing new view... 14:54:28,358 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t3) Max active partition topology: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,358 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t2) Max active partition topology: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,358 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeA-55522: installing view [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,358 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t3) One of the partitions is available, using that partition's topology 14:54:28,358 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t2) One of the partitions is available, using that partition's topology 14:54:28,359 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Updating topologies after merge for cache opt-cache, current topology = CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, stable topology = CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE, resolveConflicts = false 14:54:28,359 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Updating topologies after merge for cache ___defaultcache, current topology = CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, stable topology = CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE, resolveConflicts = false 14:54:28,359 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeA-55522: closing connections of non members [test-NodeC-10992] 14:54:28,359 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=177 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 14:54:28,359 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, availability mode = AVAILABLE 14:54:28,359 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, availability mode = AVAILABLE 14:54:28,359 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (TestNG) test-NodeA-55522: removed test-NodeC-10992 from xmit_table (not member anymore) 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t2) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,359 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Updating cluster-wide stable topology for cache ___defaultcache, topology = CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=26} 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=26} 14:54:28,359 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,359 ERROR [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t3) [Context=___defaultcache]ISPN000319: After merge (or coordinator change), cache still hasn't recovered all its data and must stay in degraded mode. Current members are [test-NodeC-10992], lost members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], stable members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:28,359 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #44, conn_id=0) 14:54:28,359 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t3) After merge, cache ___defaultcache is staying in degraded mode 14:54:28,359 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,359 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Cache ___defaultcache availability changed: AVAILABLE -> DEGRADED_MODE 14:54:28,359 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=26} 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t2) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=26} 14:54:28,359 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating local topology for cache opt-cache: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,359 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Updating availability for cache ___defaultcache to DEGRADED_MODE 14:54:28,359 ERROR [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) [Context=opt-cache]ISPN000319: After merge (or coordinator change), cache still hasn't recovered all its data and must stay in degraded mode. Current members are [test-NodeC-10992], lost members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], stable members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:28,359 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#44 14:54:28,359 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t2) After merge, cache opt-cache is staying in degraded mode 14:54:28,359 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,359 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,359 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Cache opt-cache availability changed: AVAILABLE -> DEGRADED_MODE 14:54:28,359 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Cache ___defaultcache topology updated: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, members = [test-NodeC-10992], joiners = [] 14:54:28,359 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,359 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000094: Received new cluster view for channel ISPN: [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,359 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache ___defaultcache 14:54:28,359 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Updating availability for cache opt-cache to DEGRADED_MODE 14:54:28,359 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [], Left: [test-NodeC-10992] 14:54:28,359 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,359 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,359 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Cache opt-cache topology updated: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, members = [test-NodeC-10992], joiners = [] 14:54:28,359 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,359 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 14: CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,359 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t5) Installing new cache topology CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 14 from test-NodeB-18592: SuccessfulResponse({MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=2}}) 14:54:28,359 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@a9f2daf passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,359 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, availability mode = DEGRADED_MODE 14:54:28,359 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Received new cluster view: 27, isCoordinator = true, old status = COORDINATOR 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=DEGRADED_MODE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating cluster members for all the caches. New list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,359 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, availability mode = DEGRADED_MODE 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=DEGRADED_MODE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending request 15 to all: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=test-NodeA-55522, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=-1} 14:54:28,359 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending test-NodeA-55522#38 14:54:28,359 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, NAKACK2: [MSG, seqno=38], TP: [cluster_name=ISPN] 14:54:28,360 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 used 7 credits, 1847258 remaining 14:54:28,359 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 14 is installed 14:54:28,359 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t2) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=DEGRADED_MODE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,360 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, NAKACK2: [MSG, seqno=38], TP: [cluster_name=ISPN] 14:54:28,360 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, NAKACK2: [MSG, seqno=38], TP: [cluster_name=ISPN] 14:54:28,359 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100001: Node test-NodeC-10992 left the cluster 14:54:28,359 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,360 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:28,359 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=DEGRADED_MODE, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], throwable=null, viewId=26} 14:54:28,360 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@4ba22794 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,360 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating cluster members for all the caches. New list is [test-NodeC-10992] 14:54:28,360 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#38 14:54:28,360 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599828666155008 14:54:28,360 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@9a20fd7 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,360 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,360 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,360 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#38 14:54:28,360 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#38 14:54:28,360 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,360 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599828666155008 14:54:28,360 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 15 from test-NodeA-55522: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:28,360 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,360 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t1) The cluster has a single node: no need to broadcast command CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=test-NodeC-10992, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=-1} 14:54:28,360 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t5) (isRunning=true) Installed new topology 14: CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,360 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@dc6864b passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,360 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,360 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599828666155008 14:54:28,360 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#38 14:54:28,360 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Cluster members updated for cache opt-cache, no abrupt leavers detected: cache members = [test-NodeC-10992]. Existing members = [test-NodeC-10992] 14:54:28,360 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,360 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 15 from test-NodeA-55522: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:28,360 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling topology 14 is installed 14:54:28,360 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeA-p131-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,360 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeA-55522] 14:54:28,361 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeA-55522] 14:54:28,361 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:28,361 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,361 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,361 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 7 credits, 1896072 remaining 14:54:28,361 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,361 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling transaction data received for topology 14 14:54:28,361 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992], remote transactions: 0 14:54:28,361 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,361 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Removing no longer owned entries for cache opt-cache 14:54:28,361 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,361 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Topology changed, recalculating minTopologyId 14:54:28,361 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Changing minimum topology ID from 13 to 14 14:54:28,360 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 14 14:54:28,361 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t1) Cache opt-cache is not available, updating the actual members only 14:54:28,361 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (remote-thread-test-NodeA-p130-t4) Response(s) to VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} is {test-NodeC-10992=CacheNotFoundResponse, test-NodeB-18592=SuccessfulResponse({MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=2}})} 14:54:28,361 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 15 to test-NodeA-55522: SuccessfulResponse(true) 14:54:28,361 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Removing no longer owned entries for cache ___defaultcache 14:54:28,361 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeB-18592: installing view [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,361 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeA-55522: #22, conn_id=0) 14:54:28,361 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,361 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 7 credits, 1847258 remaining 14:54:28,361 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeB-18592: closing connections of non members [test-NodeC-10992] 14:54:28,361 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeA-p131-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,361 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,361 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 15 to test-NodeA-55522: SuccessfulResponse(true) 14:54:28,361 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (TestNG) test-NodeB-18592: removed test-NodeC-10992 from xmit_table (not member anymore) 14:54:28,361 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 14:54:28,361 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,361 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (remote-thread-test-NodeA-p130-t4) Current topology 13, command topology 13 14:54:28,361 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Cluster members updated for cache ___defaultcache, no abrupt leavers detected: cache members = [test-NodeC-10992]. Existing members = [test-NodeC-10992] 14:54:28,361 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t1) Cache ___defaultcache is not available, updating the actual members only 14:54:28,361 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,361 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #45, conn_id=0) 14:54:28,361 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,361 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 14:54:28,362 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating local topology for cache opt-cache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,362 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,361 TRACE [org.infinispan.interceptors.distribution.TxDistributionInterceptor] (remote-thread-test-NodeA-p130-t4) Cache not running on node test-NodeC-10992, or the node is missing 14:54:28,362 DEBUG [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating availability for cache ___defaultcache: AVAILABLE -> DEGRADED_MODE 14:54:28,362 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,362 DEBUG [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating availability for cache opt-cache: AVAILABLE -> DEGRADED_MODE 14:54:28,362 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@434f4980 passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=true, cache=Cache '___defaultcache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:28,362 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@2c73345a passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:28,362 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@434f4980 passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=false, cache=Cache '___defaultcache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:28,362 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@2c73345a passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:28,362 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache ___defaultcache 14:54:28,362 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (remote-thread-test-NodeA-p130-t4) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with 4 handlers 14:54:28,362 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,362 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t5) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} on cache opt-cache 14:54:28,362 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,362 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (remote-thread-test-NodeA-p130-t4) Waiting for transaction data for topology 14, current topology is 13 14:54:28,362 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 15 is installed 14:54:28,363 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,362 DEBUG [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-10,test-NodeB-18592) test-NodeB-18592: socket to test-NodeC-10992 was closed gracefully 14:54:28,363 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 14:54:28,363 DEBUG [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-10,test-NodeB-18592) test-NodeB-18592: ping_dest is test-NodeD-25447, pingable_mbrs=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,363 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,363 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,363 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t5) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:28,363 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling topology 15 is installed 14:54:28,363 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,363 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,363 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000094: Received new cluster view for channel ISPN: [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,363 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK acceptor-4,test-NodeD-25447) test-NodeD-25447: accepted connection from /127.0.0.1:50131 14:54:28,363 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [], Left: [test-NodeC-10992] 14:54:28,363 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-10,test-NodeB-18592) test-NodeB-18592: ping_dest=test-NodeD-25447, ping_sock=Socket[addr=/127.0.0.1,port=46159,localport=50131], cache=test-NodeA-55522: 127.0.0.1:40955 (579 ms old) test-NodeB-18592: 127.0.0.1:46123 (579 ms old) test-NodeD-25447: 127.0.0.1:46159 (465 ms old) 14:54:28,363 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,363 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:28,363 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:28,363 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #22, conn_id=0) 14:54:28,363 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,363 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#22 14:54:28,363 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@47525ccd passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,363 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,363 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,363 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 15 14:54:28,363 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received response for request 15 from test-NodeD-25447: SuccessfulResponse(true) 14:54:28,363 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeB-p140-t4) Received new cluster view: 27, isCoordinator = false, old status = REGULAR_MEMBER 14:54:28,363 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100001: Node test-NodeC-10992 left the cluster 14:54:28,363 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,363 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@afb1195 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,363 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Removing no longer owned entries for cache ___defaultcache 14:54:28,363 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling transaction data received for topology 15 14:54:28,363 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599832961122304 14:54:28,363 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992], remote transactions: 0 14:54:28,363 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@765f3eda passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,363 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,363 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,363 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599832961122304 14:54:28,363 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,363 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Removing no longer owned entries for cache opt-cache 14:54:28,363 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@25ef69f9 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,363 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599832961122304 14:54:28,363 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,363 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeB-p139-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:28,363 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,363 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeB-p139-t1) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:28,363 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Topology changed, recalculating minTopologyId 14:54:28,363 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeD-25447: installing view [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,363 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Changing minimum topology ID from 14 to 15 14:54:28,363 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeB-p139-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,363 TRACE [org.jgroups.protocols.UNICAST3] (TestNG) test-NodeD-25447: closing connections of non members [test-NodeC-10992] 14:54:28,363 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,363 DEBUG [org.jgroups.protocols.pbcast.NAKACK2] (TestNG) test-NodeD-25447: removed test-NodeC-10992 from xmit_table (not member anymore) 14:54:28,363 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,364 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,364 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,364 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000094: Received new cluster view for channel ISPN: [test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,364 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [], Left: [test-NodeC-10992] 14:54:28,364 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,364 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@46db06db passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,364 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeD-p156-t6) Received new cluster view: 27, isCoordinator = false, old status = REGULAR_MEMBER 14:54:28,364 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100001: Node test-NodeC-10992 left the cluster 14:54:28,364 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@fe1cb8e passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,364 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599837256089600 14:54:28,364 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@362cf0e7 passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,364 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599837256089600 14:54:28,364 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,364 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.container.versioning.NumericVersionGenerator$RankCalculator@68d2e77a passing event EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} 14:54:28,364 TRACE [org.infinispan.container.versioning.NumericVersionGenerator] (TestNG) Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=27, subgroupsMerged=null, mergeView=false} and result was 7599837256089600 14:54:28,364 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,364 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeD-p155-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,364 TRACE [org.infinispan.transaction.impl.TransactionTable] (timeout-thread-test-NodeD-p155-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,364 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) New views installed 14:54:28,364 DEBUG [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Cluster split. 14:54:28,364 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeC-10992) [Blocking] Unblocking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,364 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeC-10992) Checking if transaction data was received for topology 13, current topology is 15 14:54:28,364 WARN [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (jgroups-7,test-NodeC-10992) ISPN000071: Caught exception when handling command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=false, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} java.lang.IllegalStateException: Cannot create remote transaction GlobalTx:test-NodeA-55522:15, the originator is not in the cluster view at org.infinispan.transaction.impl.TransactionTable.getOrCreateRemoteTransaction(TransactionTable.java:373) ~[classes/:?] at org.infinispan.transaction.impl.TransactionTable.getOrCreateRemoteTransaction(TransactionTable.java:358) ~[classes/:?] at org.infinispan.commands.tx.PrepareCommand.createContext(PrepareCommand.java:120) ~[classes/:?] at org.infinispan.commands.tx.PrepareCommand.createContext(PrepareCommand.java:56) ~[classes/:?] at org.infinispan.remoting.inboundhandler.action.PendingTxAction.createContext(PendingTxAction.java:107) ~[classes/:?] at org.infinispan.remoting.inboundhandler.action.PendingTxAction.init(PendingTxAction.java:57) ~[classes/:?] at org.infinispan.remoting.inboundhandler.action.BaseLockingAction.check(BaseLockingAction.java:39) ~[classes/:?] at org.infinispan.remoting.inboundhandler.action.DefaultReadyAction.isReady(DefaultReadyAction.java:42) ~[classes/:?] at org.infinispan.remoting.inboundhandler.action.DefaultReadyAction.isReady(DefaultReadyAction.java:45) ~[classes/:?] at org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler$1.isReady(NonTotalOrderTxPerCacheInboundInvocationHandler.java:116) ~[classes/:?] at org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl.execute(BlockingTaskAwareExecutorServiceImpl.java:51) ~[classes/:?] at org.infinispan.executors.LazyInitializingBlockingTaskAwareExecutorService.execute(LazyInitializingBlockingTaskAwareExecutorService.java:46) ~[classes/:?] at org.infinispan.remoting.inboundhandler.BasePerCacheInboundInvocationHandler.handleRunnable(BasePerCacheInboundInvocationHandler.java:148) [classes/:?] at org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler.handle(NonTotalOrderTxPerCacheInboundInvocationHandler.java:92) [classes/:?] at org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest$ControlledInboundHandler.handle(BaseTxPartitionAndMergeTest.java:199) [test-classes/:?] at org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler.handleCacheRpcCommand(GlobalInboundInvocationHandler.java:120) [classes/:?] at org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler.handleFromCluster(GlobalInboundInvocationHandler.java:79) [classes/:?] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.processRequest(JGroupsTransport.java:1304) [classes/:?] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.processMessage(JGroupsTransport.java:1235) [classes/:?] at org.infinispan.remoting.transport.jgroups.JGroupsTransport.access$200(JGroupsTransport.java:121) [classes/:?] at org.infinispan.remoting.transport.jgroups.JGroupsTransport$ChannelCallbacks.receive(JGroupsTransport.java:1366) [classes/:?] at org.jgroups.JChannel.up(JChannel.java:819) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.stack.ProtocolStack.up(ProtocolStack.java:893) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.RSVP.up(RSVP.java:163) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.FlowControl.up(FlowControl.java:351) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.tom.TOA.up(TOA.java:112) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.pbcast.GMS.up(GMS.java:867) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:240) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.UNICAST3.deliverMessage(UNICAST3.java:1001) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.UNICAST3.handleDataReceived(UNICAST3.java:727) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.UNICAST3.up(UNICAST3.java:382) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:600) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:129) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.FD_ALL.up(FD_ALL.java:197) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:252) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.MERGE3.up(MERGE3.java:276) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.Discovery.up(Discovery.java:262) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.protocols.TP.passMessageUp(TP.java:1229) [jgroups-4.0.4.Final.jar:4.0.4.Final] at org.jgroups.util.SubmitToThreadPool$SingleMessageHandler.run(SubmitToThreadPool.java:87) [jgroups-4.0.4.Final.jar:4.0.4.Final] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_77] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_77] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] 14:54:28,365 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 sending response for request 14 to test-NodeA-55522: ExceptionResponse(java.lang.IllegalStateException: Cannot create remote transaction GlobalTx:test-NodeA-55522:15, the originator is not in the cluster view) 14:54:28,365 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 --> DATA(test-NodeA-55522: #31, conn_id=0) 14:54:28,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) 127.0.0.1:7902: connecting to 127.0.0.1:7900 14:54:28,366 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=3417 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,366 TRACE [org.jgroups.protocols.DISCARD] (jgroups-8,test-NodeA-55522) null: dropping message from test-NodeC-10992 14:54:28,367 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 14:54:28,367 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #45, conn_id=0) 14:54:28,367 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#45 14:54:28,367 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 15 from test-NodeB-18592: SuccessfulResponse(true) 14:54:28,367 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cluster members updated for cache opt-cache: members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,367 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Updating availability for cache opt-cache to AVAILABLE 14:54:28,367 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cache opt-cache topology updated: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,367 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,367 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,367 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,367 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,367 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending test-NodeA-55522#39 14:54:28,367 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=39], TP: [cluster_name=ISPN] 14:54:28,367 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,367 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,367 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 used 3360 credits, 1843898 remaining 14:54:28,367 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3360 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=39], TP: [cluster_name=ISPN] 14:54:28,367 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#39 14:54:28,367 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3360 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=39], TP: [cluster_name=ISPN] 14:54:28,367 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,367 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#39 14:54:28,367 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#39 14:54:28,367 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#39 14:54:28,367 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,367 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,367 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cache opt-cache topology updated: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,367 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,367 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,367 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,367 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,367 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 3360 credits, 1843898 remaining 14:54:28,367 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,367 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,367 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,367 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3360 credits, 1892712 remaining 14:54:28,368 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache opt-cache: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,368 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t1) Updating local topology for cache opt-cache: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 14: CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 14 is installed 14:54:28,368 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,368 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,368 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,368 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending test-NodeA-55522#40 14:54:28,368 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255} 14:54:28,368 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=40], TP: [cluster_name=ISPN] 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t1) Installing new cache topology CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,368 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,368 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 used 2860 credits, 1841038 remaining 14:54:28,368 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,368 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,368 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=2860 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=40], TP: [cluster_name=ISPN] 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 14 14:54:28,368 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Queueing rebalance for cache opt-cache with members [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,368 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,368 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Rebalancing consistent hash for cache opt-cache, members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,368 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=2860 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=40], TP: [cluster_name=ISPN] 14:54:28,368 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (transport-thread-test-NodeA-p132-t1) Added a new task directly: 0 task(s) are waiting 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#40 14:54:28,368 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#40 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 14: CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.infinispan.interceptors.impl.BaseStateTransferInterceptor$CancellableRetry] (remote-thread-test-NodeA-p130-t4) Retrying command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} for topology 14 14:54:28,368 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#40 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 14 is installed 14:54:28,368 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#40 14:54:28,368 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (remote-thread-test-NodeA-p130-t4) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with 2 handlers 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: new segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251}; old segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251} 14:54:28,368 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,368 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,368 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,368 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,368 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Removing no longer owned entries for cache opt-cache 14:54:28,368 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 2860 credits, 1841038 remaining 14:54:28,368 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeA-p130-t4) Invoking: VersionedPrepareCommand 14:54:28,368 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t1) (isRunning=true) Installed new topology 14: CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 14 14:54:28,368 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (remote-thread-test-NodeA-p130-t4) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling topology 14 is installed 14:54:28,368 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,368 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:28,368 TRACE [org.infinispan.transaction.impl.LocalTransaction] (remote-thread-test-NodeA-p130-t4) Adding remote locks on [test-NodeC-10992, test-NodeB-18592]. Remote locks are [test-NodeB-18592, test-NodeC-10992] 14:54:28,368 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:28,368 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 2860 credits, 1889852 remaining 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Minimum topology ID still is 13; nothing to change 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:28,368 TRACE [org.infinispan.transaction.impl.LocalTransaction] (remote-thread-test-NodeA-p130-t4) getCommitNodes recipients=[test-NodeC-10992, test-NodeB-18592], currentTopologyId=14, members=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], txTopologyId=13 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,368 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Updating cache opt-cache topology for rebalance: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.infinispan.transaction.impl.LocalTransaction] (remote-thread-test-NodeA-p130-t4) The merged list of nodes to send commit/rollback is [test-NodeB-18592, test-NodeC-10992] 14:54:28,368 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,368 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,368 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Removing no longer owned entries for cache opt-cache 14:54:28,368 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling transaction data received for topology 14 14:54:28,368 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cache opt-cache topology updated: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,368 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,368 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,368 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Topology changed, recalculating minTopologyId 14:54:28,368 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 invoking VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} to recipient list [test-NodeB-18592, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,368 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,368 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,368 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Removing no longer owned entries for cache opt-cache 14:54:28,368 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Minimum topology ID still is 13; nothing to change 14:54:28,369 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,369 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,369 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t4) Initialized topology confirmation collector 16@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,369 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t4) ISPN000310: Starting cluster-wide rebalance for cache opt-cache, topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Topology changed, recalculating minTopologyId 14:54:28,369 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache opt-cache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Changing minimum topology ID from 13 to 14 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,369 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t4) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100002: Started rebalance with topology id 16 14:54:28,369 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=14} 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,369 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,369 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t1) Check if topology CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,369 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t1) Updating local topology for cache opt-cache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,369 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending test-NodeA-55522#41 14:54:28,369 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending request 16 to [test-NodeB-18592, test-NodeC-10992]: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=41], TP: [cluster_name=ISPN] 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #21, conn_id=0) 14:54:28,369 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 15 is installed 14:54:28,369 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 15 is installed 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t1) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: new segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251}; old segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251} 14:54:28,369 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 used 6023 credits, 1835015 remaining 14:54:28,369 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #16, conn_id=1) 14:54:28,369 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t4) Rebalance confirmation collector 16@opt-cache members list updated, remaining list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6023 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=41], TP: [cluster_name=ISPN] 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6023 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=41], TP: [cluster_name=ISPN] 14:54:28,369 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cluster members updated for cache ___defaultcache: members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,369 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#41 14:54:28,369 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#41 14:54:28,369 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#41 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=21, TP: [cluster_name=ISPN] 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255} 14:54:28,369 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Updating availability for cache ___defaultcache to AVAILABLE 14:54:28,369 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,369 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #21, conn_id=0) 14:54:28,369 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#21 14:54:28,369 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,369 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cache ___defaultcache topology updated: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,369 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) null: dropping message from test-NodeA-55522 14:54:28,369 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,369 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,369 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 6023 credits, 1883829 remaining 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,369 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#41 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 15 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 15 14:54:28,369 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,369 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:28,369 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t1) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,369 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:28,369 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,369 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,369 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,369 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling topology 15 is installed 14:54:28,369 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,369 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,369 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending test-NodeA-55522#42 14:54:28,369 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Removing no longer owned entries for cache opt-cache 14:54:28,369 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=42], TP: [cluster_name=ISPN] 14:54:28,369 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Removing no longer owned entries for cache opt-cache 14:54:28,370 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 used 3366 credits, 1831649 remaining 14:54:28,370 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,370 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,370 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Topology changed, recalculating minTopologyId 14:54:28,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=42], TP: [cluster_name=ISPN] 14:54:28,370 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t5) Minimum topology ID still is 13; nothing to change 14:54:28,370 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#42 14:54:28,370 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#42 14:54:28,370 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,370 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,370 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,370 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,370 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cache ___defaultcache topology updated: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=42], TP: [cluster_name=ISPN] 14:54:28,370 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,370 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:28,370 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,370 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,369 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 16 from test-NodeA-55522: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,370 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,370 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,370 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,370 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} [sender=test-NodeA-55522] 14:54:28,370 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeA-55522 used 3366 credits, 1837672 remaining 14:54:28,370 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,370 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Minimum topology ID still is 13; nothing to change 14:54:28,370 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeB-18592) [Notifier] Checking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:28,370 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling transaction data received for topology 15 14:54:28,370 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,370 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t1) Updating local topology for cache opt-cache: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeB-18592) [Notifier] Notifying command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:28,370 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,370 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,370 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:28,370 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,370 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,370 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t3) Installing new cache topology CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,370 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#42 14:54:28,370 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 14: CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 14 is installed 14:54:28,370 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeB-18592) Checking if transaction data was received for topology 14, current topology is 15 14:54:28,370 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,370 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t3) (isRunning=true) Installed new topology 14: CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache ___defaultcache we have: new segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251}; old segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251} 14:54:28,370 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t1) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending test-NodeA-55522#43 14:54:28,370 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,370 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=43], TP: [cluster_name=ISPN] 14:54:28,370 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,371 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 used 2866 credits, 1828783 remaining 14:54:28,370 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 6023 credits, 1831649 remaining 14:54:28,371 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,370 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#42 14:54:28,371 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Queueing rebalance for cache ___defaultcache with members [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,371 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-6,test-NodeB-18592) Checking for pending locks and then locking key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,370 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Removing no longer owned entries for cache opt-cache 14:54:28,370 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,370 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling topology 14 is installed 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,371 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 14 14:54:28,371 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,371 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling transaction data received for topology 14 14:54:28,371 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,371 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Removing no longer owned entries for cache ___defaultcache 14:54:28,371 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,371 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,371 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t3) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,371 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t3) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling topology 15 is installed 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,371 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling transaction data received for topology 15 14:54:28,371 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=16} 14:54:28,371 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Removing no longer owned entries for cache ___defaultcache 14:54:28,371 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 16: CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Rebalancing consistent hash for cache ___defaultcache, members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,371 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Start keeping track of keys for rebalance 14:54:28,371 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=2866 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=43], TP: [cluster_name=ISPN] 14:54:28,371 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=2866 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=43], TP: [cluster_name=ISPN] 14:54:28,371 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#43 14:54:28,371 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#43 14:54:28,371 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#43 14:54:28,371 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#43 14:54:28,371 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,371 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Removing no longer owned entries for cache ___defaultcache 14:54:28,371 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t1) Tracking is disabled. Clear tracker: {} 14:54:28,371 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,371 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t1) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,371 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,371 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,372 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,372 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 2866 credits, 1880963 remaining 14:54:28,371 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,371 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,372 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t2) Updating local topology for cache ___defaultcache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,371 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,371 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 16 is installed 14:54:28,372 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,372 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,372 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247}; removed segments: {} 14:54:28,372 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,372 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Topology changed, recalculating minTopologyId 14:54:28,372 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Adding inbound state transfer for segments {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247} 14:54:28,372 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Changing minimum topology ID from 14 to 15 14:54:28,372 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t2) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Requesting transactions from node test-NodeB-18592 for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,372 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=14, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t1) Installing new cache topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,372 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Updating cache ___defaultcache topology for rebalance: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t2) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling topology 15 is installed 14:54:28,372 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,372 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache ___defaultcache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,372 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 15: CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 15 is installed 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache ___defaultcache we have: new segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251}; old segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,372 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 15 14:54:28,372 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Removing no longer owned entries for cache ___defaultcache 14:54:28,372 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,372 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,372 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,372 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t4) Cache ___defaultcache topology updated: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,372 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, unionConsistentHash=null, newTopologyId=15} 14:54:28,372 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,372 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling transaction data received for topology 15 14:54:28,372 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t1) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,372 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 sending request 17 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,372 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t1) Updating local topology for cache opt-cache: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeA-55522 used 2866 credits, 1828783 remaining 14:54:28,372 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,372 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3366 credits, 1877597 remaining 14:54:28,372 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t1) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t4) Initialized topology confirmation collector 16@___defaultcache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,372 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 --> DATA(test-NodeB-18592: #22, conn_id=0) 14:54:28,372 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Removing no longer owned entries for cache ___defaultcache 14:54:28,372 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t4) ISPN000310: Starting cluster-wide rebalance for cache ___defaultcache, topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,372 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 14:54:28,372 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t2) Check if topology CacheTopology{id=15, rebalanceId=4, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t4) [Context=___defaultcache][Scope=test-NodeA-55522]ISPN100002: Started rebalance with topology id 16 14:54:28,372 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,372 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=16} 14:54:28,372 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t2) Ignoring late consistent hash update for cache ___defaultcache, current topology is 15: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,372 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,373 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t1) (isRunning=true) Installed new topology 16: CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t1) Installing new cache topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Start keeping track of keys for rebalance 14:54:28,373 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,373 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=167 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=22, TP: [cluster_name=ISPN] 14:54:28,373 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending test-NodeA-55522#44 14:54:28,373 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,373 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=44], TP: [cluster_name=ISPN] 14:54:28,373 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,373 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Starting local rebalance for cache ___defaultcache, topology = CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #22, conn_id=0) 14:54:28,373 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t1) Tracking is disabled. Clear tracker: {} 14:54:28,373 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#22 14:54:28,373 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t1) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,373 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-6,test-NodeB-18592) No transactions pending for Transaction GlobalTx:test-NodeA-55522:15 14:54:28,373 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 17 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,373 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling topology 16 is installed 14:54:28,373 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 used 6029 credits, 1822754 remaining 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t4) Rebalance confirmation collector 16@___defaultcache members list updated, remaining list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,373 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} [sender=test-NodeA-55522] 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-6,test-NodeB-18592) Stored PendingLock is NO_OP 14:54:28,373 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,373 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}}. 14:54:28,373 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6029 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=44], TP: [cluster_name=ISPN] 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251} 14:54:28,373 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@6342a1e4 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=16} 14:54:28,373 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,373 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6029 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=44], TP: [cluster_name=ISPN] 14:54:28,373 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-6,test-NodeB-18592) Registering locked key: MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,373 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#44 14:54:28,373 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-6,test-NodeB-18592) Lock key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} for owner=GlobalTx:test-NodeA-55522:15. timeout=10000 (MILLISECONDS) 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache opt-cache we have: added segments: {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253}; removed segments: {} 14:54:28,373 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t1) (isRunning=true) Installed new topology 16: CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#44 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Start keeping track of keys for rebalance 14:54:28,373 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#44 14:54:28,373 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,373 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Received request for transactions from node test-NodeA-55522 for cache opt-cache, topology id 16, segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,373 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t1) Tracking is disabled. Clear tracker: {} 14:54:28,373 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,373 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Adding inbound state transfer for segments {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253} 14:54:28,373 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#44 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-6,test-NodeB-18592) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-6,test-NodeB-18592) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-6,test-NodeB-18592) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15}. Current=null 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Requesting transactions from node test-NodeA-55522 for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-6,test-NodeB-18592) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15}) => true 14:54:28,373 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,373 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,373 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,373 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,373 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t1) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,373 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeA-55522 used 6029 credits, 1822754 remaining 14:54:28,373 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling topology 16 is installed 14:54:28,373 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 sending request 23 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-6,test-NodeB-18592) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15}. WAITING => ACQUIRED 14:54:28,373 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 --> DATA(test-NodeA-55522: #46, conn_id=0) 14:54:28,373 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t5) Installing new cache topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,373 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-6,test-NodeB-18592) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} successfully acquired the lock. 14:54:28,373 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 14:54:28,373 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,373 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Received new topology for cache ___defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: added segments: {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254}; removed segments: {} 14:54:28,373 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Adding inbound state transfer for segments {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254} 14:54:28,373 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t5) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,373 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Updating local topology for cache ___defaultcache: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@30979069 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache '___defaultcache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=16} 14:54:28,373 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Requesting transactions from node test-NodeA-55522 for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,373 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Starting local rebalance for cache ___defaultcache, topology = CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=173 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 14:54:28,373 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,373 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeB-p138-t5) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab 14:54:28,373 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,373 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Sending transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], lookedUpEntriesTopology=13, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} to new owner test-NodeA-55522 14:54:28,373 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,373 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,374 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t5) (isRunning=true) Installed new topology 16: CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,373 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #46, conn_id=0) 14:54:28,374 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Start keeping track of keys for rebalance 14:54:28,374 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,374 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeB-p138-t5) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:28,374 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t3) Starting local rebalance for cache ___defaultcache, topology = CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,374 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 sending request 17 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,374 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 --> DATA(test-NodeA-55522: #23, conn_id=0) 14:54:28,374 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeB-p138-t5) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}, origin test-NodeA-55522 14:54:28,374 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 14:54:28,374 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,374 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,374 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Found 1 transaction(s) to transfer 14:54:28,374 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Tracking is disabled. Clear tracker: {} 14:54:28,374 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#46 14:54:28,374 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,374 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) Installing new cache topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,374 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received request 23 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,374 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 6029 credits, 1871568 remaining 14:54:28,374 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=149 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 14:54:28,374 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} [sender=test-NodeB-18592] 14:54:28,374 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeB-p138-t5) Acquiring locks on MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. 14:54:28,374 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,374 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 17 to test-NodeA-55522: SuccessfulResponse([TransactionInfo{globalTransaction=GlobalTx:test-NodeA-55522:15, topologyId=13, modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lockedKeys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}]}]) 14:54:28,374 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeB-p138-t5) Acquiring locks on MagicKey#k1{8/537A1109/107@test-NodeB-18592}. 14:54:28,374 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t3) Installing new cache topology CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,374 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (remote-thread-test-NodeB-p138-t5) Await for pending transactions for transaction GlobalTx:test-NodeA-55522:15 using NO_OP 14:54:28,374 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #23, conn_id=0) 14:54:28,374 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,374 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeB-p138-t5) Registering locked key: MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,374 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,374 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Received new topology for cache ___defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,374 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling topology 16 is installed 14:54:28,374 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Received new topology for cache ___defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,374 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeB-p138-t5) Registering locked key: MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,374 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#23 14:54:28,374 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@39404c3d passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache '___defaultcache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=16} 14:54:28,374 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 17 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,374 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255} 14:54:28,374 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@69b2f2d1 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache '___defaultcache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=16} 14:54:28,374 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache ___defaultcache we have: added segments: {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247}; removed segments: {} 14:54:28,374 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Received request for transactions from node test-NodeB-18592 for cache opt-cache, topology id 16, segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,374 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t3) (isRunning=true) Installed new topology 16: CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,374 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Adding inbound state transfer for segments {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247} 14:54:28,374 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeB-p138-t5) Lock all keys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}] for owner=GlobalTx:test-NodeA-55522:15. timeout=10000 (MILLISECONDS) 14:54:28,374 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} [sender=test-NodeD-25447] 14:54:28,374 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Start keeping track of keys for rebalance 14:54:28,374 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Adding transfer from test-NodeB-18592 for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,374 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,374 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,374 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,374 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Skipping transaction LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010}} LocalTransaction{remoteLockedNodes=[test-NodeB-18592, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f because the state requestor test-NodeB-18592 doesn't own any key 14:54:28,374 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t3) Tracking is disabled. Clear tracker: {} 14:54:28,374 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Received request for transactions from node test-NodeD-25447 for cache opt-cache, topology id 16, segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,374 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t2) (isRunning=true) Installed new topology 16: CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,374 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t3) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,374 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Found 0 transaction(s) to transfer 14:54:28,374 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling topology 16 is installed 14:54:28,374 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #47, conn_id=0) 14:54:28,374 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:28,375 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 14:54:28,375 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Skipping transaction LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010}} LocalTransaction{remoteLockedNodes=[test-NodeB-18592, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f because the state requestor test-NodeD-25447 doesn't own any key 14:54:28,375 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:28,375 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,375 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=641 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #47, conn_id=0) 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#47 14:54:28,375 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t1) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,375 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) test-NodeA-55522 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,375 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t1) test-NodeA-55522 sending request 18 to test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t1) test-NodeA-55522 --> DATA(test-NodeB-18592: #23, conn_id=0) 14:54:28,375 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t1) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 14:54:28,375 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=173 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=23, TP: [cluster_name=ISPN] 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #23, conn_id=0) 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#23 14:54:28,375 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 18 from test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,375 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} [sender=test-NodeA-55522] 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Adding transfer from test-NodeD-25447 for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Start keeping track of keys for rebalance 14:54:28,375 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 23 to test-NodeB-18592: SuccessfulResponse([]) 14:54:28,375 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,375 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Found 0 transaction(s) to transfer 14:54:28,375 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 17 to test-NodeD-25447: SuccessfulResponse([]) 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #14, conn_id=2) 14:54:28,375 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeB) Tasks to be executed=0, still pending=~1 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache ___defaultcache we have: added segments: {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254}; removed segments: {} 14:54:28,375 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,375 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Adding inbound state transfer for segments {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254} 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #24, conn_id=0) 14:54:28,375 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t5) Exists in context? VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,375 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Tracking is disabled. Clear tracker: {} 14:54:28,375 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:28,375 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling topology 16 is installed 14:54:28,375 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task to the queue: 1 task(s) are waiting 14:54:28,375 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=17, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #14, conn_id=2) 14:54:28,375 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#14 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251} 14:54:28,375 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received response for request 17 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,375 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeB) Tasks to be executed=1, still pending=~1 14:54:28,375 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-8,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,375 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,375 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Requesting transactions from node test-NodeB-18592 for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Finished adding inbound state transfer for segments {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247} 14:54:28,375 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Topology update processed, stateTransferTopologyId = 16, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling transaction data received for topology 16 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 sending request 18 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 --> DATA(test-NodeB-18592: #6, conn_id=1) 14:54:28,376 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) Check if topology CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache ___defaultcache we have: added segments: {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253}; removed segments: {} 14:54:28,375 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t5) Invoking: PutKeyValueCommand 14:54:28,376 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Adding inbound state transfer for segments {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253} 14:54:28,376 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=197 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #6, conn_id=1) 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#6 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 18 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Adding transfer from test-NodeA-55522 for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,376 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} [sender=test-NodeD-25447] 14:54:28,375 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t5) Exists in context? VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,376 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-9,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}}. 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Adding transfer from test-NodeA-55522 for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Adding transfer from test-NodeB-18592 for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,375 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Starting outbound transfer to node test-NodeA-55522 for cache ___defaultcache, topology id 16, segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,376 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Finished adding inbound state transfer for segments {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254} 14:54:28,376 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Topology update processed, stateTransferTopologyId = 16, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling transaction data received for topology 16 14:54:28,376 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending request 19 to test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Received request for transactions from node test-NodeD-25447 for cache opt-cache, topology id 16, segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Adding transfer from test-NodeD-25447 for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #24, conn_id=0) 14:54:28,376 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #24, conn_id=0) 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received response for request 17 from test-NodeB-18592: SuccessfulResponse([TransactionInfo{globalTransaction=GlobalTx:test-NodeA-55522:15, topologyId=13, modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lockedKeys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}]}]) 14:54:28,376 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Adding outbound transfer to test-NodeA-55522 for segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,376 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,376 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=155 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=24, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#24 14:54:28,376 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) Check if topology CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 23 from test-NodeA-55522: SuccessfulResponse([]) 14:54:28,376 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t3) Sending last chunk to node test-NodeA-55522 containing 0 cache entries from segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Finished adding inbound state transfer for segments {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Sending transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], lookedUpEntriesTopology=14, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} to new owner test-NodeD-25447 14:54:28,376 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,376 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,376 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t5) Invoking: PutKeyValueCommand 14:54:28,376 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Found 1 transaction(s) to transfer 14:54:28,376 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 sending request 24 to test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Topology update processed, stateTransferTopologyId = 16, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,376 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling transaction data received for topology 16 14:54:28,376 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-8,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} is {test-NodeB-18592=SuccessfulResponse([TransactionInfo{globalTransaction=GlobalTx:test-NodeA-55522:15, topologyId=13, modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lockedKeys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}]}])} 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #24, conn_id=0) 14:54:28,376 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#24 14:54:28,376 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Applying 1 transactions for cache opt-cache transferred from node test-NodeB-18592 14:54:28,376 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) Check if topology CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Requesting transactions from node test-NodeD-25447 for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,376 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 sending request 19 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 --> DATA(test-NodeD-25447: #15, conn_id=2) 14:54:28,376 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 18 to test-NodeA-55522: SuccessfulResponse(null) 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received request 19 from test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #49, conn_id=0) 14:54:28,376 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=161 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Requesting transactions from node test-NodeD-25447 for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,376 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #48, conn_id=0) 14:54:28,376 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t5) Invoking: VersionedPrepareCommand 14:54:28,377 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 14:54:28,376 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 sending request 25 to test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 --> DATA(test-NodeA-55522: #50, conn_id=0) 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #15, conn_id=2) 14:54:28,377 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (remote-thread-test-NodeB-p138-t5) Comparing versions SimpleClusteredVersion{topologyId=13, version=1} and SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k1{8/537A1109/107@test-NodeB-18592}: EQUAL 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 18 to test-NodeD-25447: SuccessfulResponse([TransactionInfo{globalTransaction=GlobalTx:test-NodeA-55522:15, topologyId=13, modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}], lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]}]) 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 sending request 26 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,377 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (remote-thread-test-NodeB-p138-t5) Comparing versions SimpleClusteredVersion{topologyId=13, version=1} and SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}: EQUAL 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} [sender=test-NodeD-25447] 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#15 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=179 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 --> DATA(test-NodeD-25447: #6, conn_id=2) 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Starting outbound transfer to node test-NodeD-25447 for cache ___defaultcache, topology id 16, segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,377 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeB-p138-t5) Verifying transaction: alreadyCompleted=false 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 19 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #50, conn_id=0) 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Adding outbound transfer to test-NodeD-25447 for segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} [sender=test-NodeA-55522] 14:54:28,377 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,377 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#50 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Received request for transactions from node test-NodeA-55522 for cache opt-cache, topology id 16, segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,377 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeB-p138-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], lookedUpEntriesTopology=14, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Found 0 transaction(s) to transfer 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=167 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 19 to test-NodeD-25447: SuccessfulResponse(null) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeD-25447: #7, conn_id=2) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #16, conn_id=2) 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 25 from test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 19 to test-NodeA-55522: SuccessfulResponse([]) 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} [sender=test-NodeB-18592] 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeA-55522: #25, conn_id=0) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #6, conn_id=2) 14:54:28,377 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=258 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 16 to test-NodeA-55522: UnsureResponse 14:54:28,377 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Starting outbound transfer to node test-NodeB-18592 for cache ___defaultcache, topology id 16, segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeA-55522: #51, conn_id=0) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #48, conn_id=0) 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Adding outbound transfer to test-NodeB-18592 for segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#48 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=641 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #7, conn_id=2) 14:54:28,377 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t3) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 sending request 20 to test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 24 from test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #25, conn_id=0) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#6 14:54:28,377 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 26 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #17, conn_id=2) 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} [sender=test-NodeB-18592] 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=2 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=51, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #51, conn_id=0) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#7 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=18, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 25 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #49, conn_id=0) 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#51 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Received request for transactions from node test-NodeB-18592 for cache opt-cache, topology id 16, segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #16, conn_id=2) 14:54:28,377 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 16 from test-NodeB-18592: UnsureResponse 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#16 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 sending request 21 to test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,377 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,377 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} [sender=test-NodeB-18592] 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#25 14:54:28,378 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-8,test-NodeA-55522) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,378 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 19 from test-NodeD-25447: SuccessfulResponse([]) 14:54:28,378 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,378 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} is {test-NodeD-25447=SuccessfulResponse([])} 14:54:28,378 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 --> DATA(test-NodeB-18592: #26, conn_id=0) 14:54:28,378 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Applying 0 transactions for cache opt-cache transferred from node test-NodeD-25447 14:54:28,377 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 19 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,377 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Found 0 transaction(s) to transfer 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#49 14:54:28,378 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 18 from test-NodeB-18592: SuccessfulResponse([TransactionInfo{globalTransaction=GlobalTx:test-NodeA-55522:15, topologyId=13, modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}], lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]}]) 14:54:28,378 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,377 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #25, conn_id=0) 14:54:28,378 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 26 to test-NodeB-18592: SuccessfulResponse([]) 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeB-18592: #7, conn_id=1) 14:54:28,378 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} is {test-NodeB-18592=SuccessfulResponse([TransactionInfo{globalTransaction=GlobalTx:test-NodeA-55522:15, topologyId=13, modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}], lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]}])} 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Adding transfer from test-NodeB-18592 for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,378 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Applying 1 transactions for cache opt-cache transferred from node test-NodeB-18592 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=25, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} is {test-NodeC-10992=CacheNotFoundResponse, test-NodeB-18592=UnsureResponse} 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received response for request 18 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #7, conn_id=1) 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#7 14:54:28,378 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received response for request 26 from test-NodeD-25447: SuccessfulResponse([]) 14:54:28,378 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-9,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} is {test-NodeD-25447=SuccessfulResponse([])} 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=268 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #26, conn_id=0) 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#26 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=228 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,378 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Applying 0 transactions for cache opt-cache transferred from node test-NodeD-25447 14:54:28,378 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Adding transfer from test-NodeD-25447 for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Finished adding inbound state transfer for segments {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = 16, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 16 14:54:28,378 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,378 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 40 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 40 of cache ___defaultcache 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 20 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 50 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 50 of cache ___defaultcache 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 19 14:54:28,378 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,378 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,378 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t2) test-NodeA-55522 sending request 22 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t2) test-NodeA-55522 --> DATA(test-NodeB-18592: #27, conn_id=0) 14:54:28,378 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t2) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Adding transfer from test-NodeA-55522 for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Adding transfer from test-NodeB-18592 for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Finished adding inbound state transfer for segments {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Topology update processed, stateTransferTopologyId = 16, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,379 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling transaction data received for topology 16 14:54:28,379 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:28,379 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:28,379 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,379 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,379 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,379 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,379 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Topology changed, recalculating minTopologyId 14:54:28,379 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Minimum topology ID still is 15; nothing to change 14:54:28,379 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 sending request 20 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 --> DATA(test-NodeA-55522: #26, conn_id=0) 14:54:28,379 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=167 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #27, conn_id=0) 14:54:28,379 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t1) Check if topology CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #25, conn_id=0) 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#27 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#25 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeA-55522: #24) 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-17,test-NodeA-55522) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,378 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 54 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Adding transfer from test-NodeA-55522 for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,378 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with 2 handlers 14:54:28,378 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, finishedSegments={}, unfinishedSegments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4e414ef0[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,378 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 21 from test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,379 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Adding transfer from test-NodeD-25447 for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,378 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #17, conn_id=2) 14:54:28,379 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,379 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 54 of cache ___defaultcache 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#17 14:54:28,379 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t1) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,379 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=24, ts=11, TP: [cluster_name=ISPN] 14:54:28,379 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:28,379 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 sending request 27 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,379 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Minimum topology ID still is 13; nothing to change 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #52, conn_id=0) 14:54:28,379 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received request 20 from test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeD-25447: #7) 14:54:28,379 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 22 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,379 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} [sender=test-NodeA-55522] 14:54:28,379 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 25 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=7, conn_id=1, ts=12, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=24, ts=11, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=149 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=26, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeC-10992: #15) 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #26, conn_id=0) 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#26 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=7, conn_id=1, ts=12, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeB-18592: #7, conn-id=1, ts=12) 14:54:28,379 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with 1 handlers 14:54:28,379 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}, finishedSegments={40 50}, unfinishedSegments={54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@791177f8[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,379 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} [sender=test-NodeA-55522] 14:54:28,379 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Finished adding inbound state transfer for segments {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253} 14:54:28,379 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} [sender=test-NodeA-55522] 14:54:28,379 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 20 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Topology update processed, stateTransferTopologyId = 16, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=13, TP: [cluster_name=ISPN] 14:54:28,380 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} [sender=test-NodeD-25447] 14:54:28,379 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeB-18592: #24, conn-id=0, ts=11) 14:54:28,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=173 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=52, TP: [cluster_name=ISPN] 14:54:28,379 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,380 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #52, conn_id=0) 14:54:28,379 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-15,test-NodeD-25447) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,380 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (jgroups-15,test-NodeA-55522) Retrying command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} for topology 16 14:54:28,380 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,380 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) 127.0.0.1:7901: connecting to 127.0.0.1:7902 14:54:28,380 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (jgroups-15,test-NodeA-55522) Acquiring backup locks on MagicKey#k1{8/537A1109/107@test-NodeB-18592}. 14:54:28,380 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (jgroups-15,test-NodeA-55522) Invoking: VersionedPrepareCommand 14:54:28,380 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (jgroups-15,test-NodeA-55522) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 14:54:28,380 TRACE [org.infinispan.transaction.impl.LocalTransaction] (jgroups-15,test-NodeA-55522) Adding remote locks on [test-NodeB-18592, test-NodeD-25447, test-NodeA-55522]. Remote locks are [test-NodeB-18592, test-NodeC-10992] 14:54:28,380 TRACE [org.infinispan.transaction.impl.LocalTransaction] (jgroups-15,test-NodeA-55522) getCommitNodes recipients=[test-NodeB-18592, test-NodeD-25447, test-NodeA-55522], currentTopologyId=16, members=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], txTopologyId=13 14:54:28,380 TRACE [org.infinispan.transaction.impl.LocalTransaction] (jgroups-15,test-NodeA-55522) The merged list of nodes to send commit/rollback is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,380 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) test-NodeA-55522 invoking VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} to recipient list [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,380 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling transaction data received for topology 16 14:54:28,380 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-9,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}}. 14:54:28,380 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,380 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,380 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeB-18592) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,380 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 18 14:54:28,380 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Starting outbound transfer to node test-NodeD-25447 for cache opt-cache, topology id 16, segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,380 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 80 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,380 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,380 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 57 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 57 of cache ___defaultcache 14:54:28,380 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Starting outbound transfer to node test-NodeA-55522 for cache opt-cache, topology id 16, segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,380 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Adding outbound transfer to test-NodeA-55522 for segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,380 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=13, TP: [cluster_name=ISPN] 14:54:28,380 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) null: dropping message from test-NodeB-18592 14:54:28,380 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 22 to test-NodeA-55522: SuccessfulResponse(null) 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 66 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 66 of cache ___defaultcache 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 16 14:54:28,381 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t4) Sending last chunk to node test-NodeA-55522 containing 1 cache entries from segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,381 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,381 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 sending request 28 to test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,381 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #54, conn_id=0) 14:54:28,381 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster_name=ISPN] 14:54:28,381 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=459 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=54, TP: [cluster_name=ISPN] 14:54:28,381 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #54, conn_id=0) 14:54:28,381 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#54 14:54:28,381 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 28 from test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,381 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} [sender=test-NodeB-18592] 14:54:28,381 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeA-55522) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,381 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,381 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 40 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 40 of cache opt-cache 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 20 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 50 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 50 of cache opt-cache 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 19 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 54 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 54 of cache opt-cache 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 18 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 57 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 57 of cache opt-cache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 17 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 65 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 65 of cache opt-cache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 16 14:54:28,380 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 66 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,382 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:28,380 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,380 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 42 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 3 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 3 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 17 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, finishedSegments={}, unfinishedSegments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@47051583[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,380 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#52 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 42 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 2 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 8 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,382 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 27 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,381 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 107 of cache opt-cache from node test-NodeB-18592: received 1 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 66 of cache opt-cache 14:54:28,380 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 sending request 23 to [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992]: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,380 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeA-55522: #53, conn_id=0) 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 65 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 17 14:54:28,382 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 --> DATA(test-NodeB-18592: #28, conn_id=0) 14:54:28,382 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster_name=ISPN] 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,380 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Adding outbound transfer to test-NodeD-25447 for segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,380 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 80 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 6 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 39 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 39 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 21 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 65 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 15 14:54:28,382 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} [sender=test-NodeB-18592] 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 86 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 18 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 18 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,382 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t3) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} 14:54:28,382 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t3) Starting outbound transfer to node test-NodeB-18592 for cache opt-cache, topology id 16, segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,382 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeA-p135-t3) Created a new local transaction: LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@10 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 8 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 2 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 15 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 16 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 14 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 91 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,382 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Topology changed, recalculating minTopologyId 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 90 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Minimum topology ID still is 13; nothing to change 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 90 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 13 14:54:28,382 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Invoked with command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@501769f1] 14:54:28,382 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=16} 14:54:28,382 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, successful=true, topologyId=-1}, origin null 14:54:28,382 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Setting command topology to 16 14:54:28,382 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) Check if topology CacheTopology{id=16, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,382 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Transaction.enlistResource(TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@10}) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011} 14:54:28,382 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t3) Adding outbound transfer to test-NodeB-18592 for segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,382 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) XaResource.start() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011} 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 20 14:54:28,382 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t3) test-NodeA-55522 sending response for request 27 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 80 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,382 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t3) test-NodeA-55522 --> DATA(test-NodeB-18592: #29, conn_id=0) 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 14 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 86 of cache opt-cache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 7 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t3) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 7 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 45 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 19 14:54:28,382 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 20 to test-NodeD-25447: SuccessfulResponse(null) 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 6 of cache ___defaultcache 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 15 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 18 14:54:28,382 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #18, conn_id=2) 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 45 of cache ___defaultcache 14:54:28,382 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 14 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 --> DATA(test-NodeD-25447: #19, conn_id=2) 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 80 of cache opt-cache 14:54:28,383 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,382 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (stateTransferExecutor-thread-test-NodeA-p135-t3) start called on tx GlobalTx:test-NodeA-55522:16 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 91 of cache ___defaultcache 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 --> DATA(test-NodeC-10992: #17, conn_id=1) 14:54:28,383 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Exists in context? null 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 75 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 75 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 11 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 12 14:54:28,383 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 13 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #19, conn_id=2) 14:54:28,383 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 132 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,382 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 17 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 132 of cache opt-cache 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #29, conn_id=0) 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 48 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#19 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#29 14:54:28,383 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 111 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 111 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 113 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Retrieved from container null 14:54:28,383 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 113 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 10 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #18, conn_id=2) 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 112 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 138 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 138 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 8 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 173 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 158 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 27 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 48 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 16 14:54:28,383 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,383 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,383 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) null: dropping message from test-NodeA-55522 14:54:28,383 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, finishedSegments={}, unfinishedSegments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@348dcced[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,383 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 23 from test-NodeA-55522: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,383 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} [sender=test-NodeA-55522] 14:54:28,383 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeD-25447) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,383 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 86 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 107 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 132 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 107 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 132 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 13 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 12 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 47 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 49 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 174 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 46 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 174 of cache opt-cache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 136 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 47 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 15 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 12 14:54:28,383 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 86 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 158 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 11 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 173 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 112 of cache ___defaultcache 14:54:28,383 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#18 14:54:28,384 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeD-p154-t5) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 9 14:54:28,383 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 6 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 7 14:54:28,384 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received response for request 20 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,384 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Updated context entry null -> VersionedRepeatableReadEntry(5ed09d83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 136 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 227 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Invoking: PutKeyValueCommand 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 49 of cache ___defaultcache 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 136 of cache opt-cache 14:54:28,384 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) The return value is null 14:54:28,383 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 11 14:54:28,384 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-thread-test-NodeA-p135-t3) Release locks for keys=[]. owner=CommandInvocation:local:0 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 46 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 175 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 14 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 175 of cache opt-cache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 10 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 136 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 9 14:54:28,384 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 5 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 230 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 230 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 177 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 4 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, finishedSegments={}, unfinishedSegments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3455ffe4[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,384 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeD-p154-t5) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 254 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 254 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 177 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 227 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 1 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 13 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 55 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 81 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 55 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeA-p135-t3) Clearing locked keys: [] 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 189 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 12 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 81 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.transaction.impl.LocalTransaction] (stateTransferExecutor-thread-test-NodeA-p135-t3) Adding modification PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, successful=true, topologyId=16}. Mod list is null 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 82 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 137 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 10 14:54:28,384 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Transaction.commit() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 2 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 174 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 3 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 244 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 244 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 174 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 175 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) runPrepare() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 189 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 137 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 82 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeD-p154-t5) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}, origin test-NodeA-55522 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 11 14:54:28,384 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) XAResource.end() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@10} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 189 of cache opt-cache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 10 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 8 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 191 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 191 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 189 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 8 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 175 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 192 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 9 14:54:28,384 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished receiving state for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 143 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 192 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 143 of cache ___defaultcache 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 8 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 7 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Inbound transfer finished: InboundTransferTask{segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, finishedSegments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4e414ef0[Completed normally], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 9 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 7 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 193 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeD-p154-t5) Acquiring backup locks on MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 142 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (stateTransferExecutor-thread-test-NodeA-p135-t3) end called on tx GlobalTx:test-NodeA-55522:16(opt-cache) 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 193 of cache opt-cache 14:54:28,385 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) XaResource.prepare() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@10} 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 193 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 196 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,385 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Removing inbound transfers from node {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} for segments test-NodeA-55522 14:54:28,385 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t2) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,385 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=53, TP: [cluster_name=ISPN] 14:54:28,385 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #53, conn_id=0) 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 188 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 188 of cache ___defaultcache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 5 14:54:28,385 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t4) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,385 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #28, conn_id=0) 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 193 of cache ___defaultcache 14:54:28,385 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#28 14:54:28,385 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,385 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeD-p154-t5) Exists in context? null 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 7 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 218 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,385 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeD-p154-t5) Exists in context? null 14:54:28,384 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 142 of cache ___defaultcache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 4 14:54:28,385 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeD-p154-t5) Exists in context? null 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 218 of cache opt-cache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 6 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 225 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 225 of cache opt-cache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 5 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 226 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 226 of cache opt-cache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 4 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 246 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 246 of cache opt-cache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 3 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 247 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 247 of cache opt-cache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 2 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 196 of cache ___defaultcache 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 6 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 5 14:54:28,385 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,385 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 23 from test-NodeA-55522: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,385 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} [sender=test-NodeA-55522] 14:54:28,385 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-9,test-NodeB-18592) [Notifier] Checking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:28,385 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-9,test-NodeB-18592) [Notifier] Notifying command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:28,385 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-9,test-NodeB-18592) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,385 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-9,test-NodeB-18592) Checking for pending locks and then locking keys [] 14:54:28,385 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-9,test-NodeB-18592) No transactions pending for Transaction GlobalTx:test-NodeA-55522:15 14:54:28,385 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-9,test-NodeB-18592) Stored PendingLock is NO_OP 14:54:28,385 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,385 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 0 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 6 14:54:28,385 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,385 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#53 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 218 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,385 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 22 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,385 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 sending request 21 to test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 221 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 221 of cache ___defaultcache 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447 --> DATA(test-NodeB-18592: #8, conn_id=1) 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 195 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t2) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,385 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeD-p154-t5) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,386 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-thread-test-NodeA-p135-t3) Sending prepare command through the chain: VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeA-55522:16, cacheName='opt-cache'} 14:54:28,386 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-thread-test-NodeD-p154-t5) Adding key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} to tx GlobalTx:test-NodeA-55522:15 14:54:28,386 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Invoked with command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeA-55522:16, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@1fed97b8] 14:54:28,385 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending request 24 to test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,386 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) handleTxCommand for command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeA-55522:16, cacheName='opt-cache'}, origin null 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #30, conn_id=0) 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Segments not received yet for cache ___defaultcache: {test-NodeB-18592=[InboundTransferTask{segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, finishedSegments={}, unfinishedSegments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@de2264b[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache}]} 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,386 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 20 to test-NodeA-55522: null 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeA-55522: #27, conn_id=0) 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 196 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,386 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 sending request 25 to test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 --> DATA(test-NodeD-25447: #20, conn_id=2) 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=203 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 195 of cache ___defaultcache 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #8, conn_id=1) 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 2 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#8 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 252 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=27, TP: [cluster_name=ISPN] 14:54:28,386 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,386 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received request 21 from test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 3 14:54:28,386 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} [sender=test-NodeD-25447] 14:54:28,385 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 218 of cache ___defaultcache 14:54:28,385 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t5) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:28,386 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,386 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #27, conn_id=0) 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 252 of cache ___defaultcache 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#27 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}, finishedSegments={40 50 54 57 65-66 80 86 132 136 174-175 189 193 218 225-226 246-247}, unfinishedSegments={107 196}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@1a68151c[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,386 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeB-p138-t5) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=262 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #30, conn_id=0) 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#30 14:54:28,386 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=222 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #20, conn_id=2) 14:54:28,386 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#20 14:54:28,386 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 24 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,386 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} [sender=test-NodeA-55522] 14:54:28,386 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true}. 14:54:28,386 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeB-18592) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,386 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 196 of cache opt-cache 14:54:28,386 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Setting command topology to 16 14:54:28,386 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t3) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,386 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeD-p154-t5) Updated context entry null -> VersionedRepeatableReadEntry(9e1b501){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=null, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Before applying the received state the data container of cache opt-cache has 2 keys 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 1 14:54:28,386 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received request 25 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,386 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeB-p138-t5) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:28,386 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received response for request 20 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 1 14:54:28,386 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} [sender=test-NodeA-55522] 14:54:28,386 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t6) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 4 14:54:28,386 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-8,test-NodeA-55522) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,386 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeB-p138-t5) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}, origin test-NodeA-55522 14:54:28,386 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-15,test-NodeD-25447) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,386 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Invoking: VersionedPrepareCommand 14:54:28,386 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,386 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeB-p138-t5) Acquiring locks on MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. 14:54:28,386 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} 14:54:28,386 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeB-p138-t5) Acquiring locks on MagicKey#k1{8/537A1109/107@test-NodeB-18592}. 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,386 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (remote-thread-test-NodeB-p138-t5) Await for pending transactions for transaction GlobalTx:test-NodeA-55522:15 using NO_OP 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 42 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 2 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 42 of cache opt-cache 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 17 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 75 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 75 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 16 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 90 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 90 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 15 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 91 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 91 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 14 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 111 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 111 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 13 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 112 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 112 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 12 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 113 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 113 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 11 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 138 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 138 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 10 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 158 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 158 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 9 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 173 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 173 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 8 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 177 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 177 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 7 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 227 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 227 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 6 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 230 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 230 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 5 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 244 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 244 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 4 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 254 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 254 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 3 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 7 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 6 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 18 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeD-p154-t5) Invoking: PutKeyValueCommand 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 18 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 6 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 21 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 7 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 39 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 39 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 19 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 2 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 253 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 8 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 3 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,386 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeB-p138-t5) Registering locked key: MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,386 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) runCommit(forceRollback=false) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011} 14:54:28,386 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Completed outbound transfer to node test-NodeD-25447, segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,386 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Starting outbound transfer to node test-NodeD-25447 for cache ___defaultcache, topology id 16, segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,387 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeB-p138-t5) Registering locked key: MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:28,387 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t6) Removing completed outbound transfer of segments to test-NodeD-25447 for cache ___defaultcache, segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 247 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeB-p138-t5) Lock all keys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}] for owner=GlobalTx:test-NodeA-55522:15. timeout=10000 (MILLISECONDS) 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 247 of cache ___defaultcache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 225 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 3 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 225 of cache ___defaultcache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 2 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 8 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 253 of cache ___defaultcache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 1 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 20 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 45 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 45 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 18 14:54:28,387 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished receiving state for segments {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 17 14:54:28,387 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t6) Adding outbound transfer to test-NodeD-25447 for segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,387 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 48 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 48 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 2 14:54:28,387 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeD-p154-t5) Invoking: VersionedPrepareCommand 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 47 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 47 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t5) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 46 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeD-p154-t5) Verifying transaction: alreadyCompleted=false 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 3 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 226 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 246 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,387 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) XaResource.commit() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@10} 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 246 of cache ___defaultcache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 226 of cache ___defaultcache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 1 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 46 of cache opt-cache 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 15 14:54:28,387 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 sending response for request 21 to test-NodeD-25447: SuccessfulResponse(null) 14:54:28,387 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 sending request 29 to test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 16 14:54:28,387 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592 --> DATA(test-NodeD-25447: #8, conn_id=2) 14:54:28,387 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 --> DATA(test-NodeD-25447: #9, conn_id=2) 14:54:28,387 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished receiving state for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,387 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Inbound transfer finished: InboundTransferTask{segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, finishedSegments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@47051583[Completed normally], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Removing inbound transfers from node {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} for segments test-NodeA-55522 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 0 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,387 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Inbound transfer finished: InboundTransferTask{segments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, finishedSegments={2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3455ffe4[Completed normally], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,387 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,387 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t6) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,387 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeD-p154-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(9e1b501){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,387 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 14 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 49 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 55 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 49 of cache opt-cache 14:54:28,388 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 23 to test-NodeA-55522: SuccessfulResponse(null) 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeA-55522: #28, conn_id=0) 14:54:28,388 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished receiving state for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeA-55522: #20) 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 13 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 55 of cache opt-cache 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 12 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 81 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Segments not received yet for cache ___defaultcache: {test-NodeD-25447=[InboundTransferTask{segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, finishedSegments={}, unfinishedSegments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@6b97594a[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache}]} 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Removing inbound transfers from node {2-3 8 42 75 90-91 111-113 138 158 173 177 227 230 244 254} for segments test-NodeA-55522 14:54:28,388 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t1) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,388 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 21 to test-NodeA-55522: null 14:54:28,388 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t5) Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,388 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,388 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,388 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t5) Exists in context? VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #8, conn_id=2) 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=28, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t5) Invoking: PutKeyValueCommand 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#8 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=20, conn_id=2, ts=7, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-thread-test-NodeA-p135-t3) Committing transaction GlobalTx:test-NodeA-55522:16 14:54:28,388 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 21 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,388 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeB-p138-t5) Exists in context? VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Inbound transfer finished: InboundTransferTask{segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}, finishedSegments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@791177f8[Completed normally], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,388 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:16, cacheName='opt-cache', topologyId=-1, updatedVersions=null} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@745e3d55] 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeB-18592: #8) 14:54:28,388 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=20, conn_id=2, ts=7, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 81 of cache opt-cache 14:54:28,388 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 11 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, finishedSegments={}, unfinishedSegments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@de2264b[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 143 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 143 of cache opt-cache 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #28, conn_id=0) 14:54:28,388 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 sending request 22 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#28 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 --> DATA(test-NodeB-18592: #9, conn_id=1) 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #55, conn_id=0) 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 0 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=308 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Segments not received yet for cache opt-cache: {test-NodeB-18592=[InboundTransferTask{segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, finishedSegments={}, unfinishedSegments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@477d2ad9[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache}]} 14:54:28,388 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,388 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 25 to test-NodeA-55522: null 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=55, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 sending request 30 to test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592 --> DATA(test-NodeD-25447: #10, conn_id=2) 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t1) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=55, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #55, conn_id=0) 14:54:28,388 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received response for request 23 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=173 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 10 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 137 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 142 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 137 of cache opt-cache 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 142 of cache opt-cache 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 9 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 82 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeD-25447: #20, conn-id=2, ts=7) 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=8, conn_id=2, ts=8, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Removing inbound transfers from node {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} for segments test-NodeB-18592 14:54:28,388 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t5) Invoking: PutKeyValueCommand 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 82 of cache opt-cache 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 7 14:54:28,388 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t5) Invoking: VersionedPrepareCommand 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 8 14:54:28,388 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 188 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=8, conn_id=2, ts=8, TP: [cluster_name=ISPN] 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #10, conn_id=2) 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeD-25447: #8, conn-id=2, ts=8) 14:54:28,389 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (remote-thread-test-NodeB-p138-t5) Comparing versions SimpleClusteredVersion{topologyId=13, version=1} and SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k1{8/537A1109/107@test-NodeB-18592}: EQUAL 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#55 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeA-55522: #29, conn_id=0) 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 21 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,389 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (remote-thread-test-NodeB-p138-t5) Comparing versions SimpleClusteredVersion{topologyId=13, version=1} and SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}: EQUAL 14:54:28,389 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeB-p138-t5) Verifying transaction: alreadyCompleted=false 14:54:28,389 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeA-55522) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,388 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=197 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t3) Completed outbound transfer to node test-NodeB-18592, segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,388 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #9, conn_id=2) 14:54:28,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,389 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t3) Removing completed outbound transfer of segments to test-NodeB-18592 for cache ___defaultcache, segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Segments not received yet for cache ___defaultcache: {test-NodeD-25447=[InboundTransferTask{segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, finishedSegments={}, unfinishedSegments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7d6f3326[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache}]} 14:54:28,389 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,389 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeB-p138-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 0 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #9, conn_id=1) 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#10 14:54:28,388 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:16, cacheName='opt-cache', topologyId=-1, updatedVersions=null}, origin null 14:54:28,389 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Setting command topology to 16 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 30 from test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 23 to test-NodeA-55522: SuccessfulResponse({MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}}) 14:54:28,389 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} [sender=test-NodeB-18592] 14:54:28,389 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) Invoking: VersionedCommitCommand 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=29, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #29, conn_id=0) 14:54:28,389 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-thread-test-NodeA-p135-t3) About to commit entry VersionedRepeatableReadEntry(5ed09d83){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,389 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,389 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Starting outbound transfer to node test-NodeB-18592 for cache ___defaultcache, topology id 16, segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,389 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Adding outbound transfer to test-NodeB-18592 for segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 30 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,389 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t4) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeA-55522: #56, conn_id=0) 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#9 14:54:28,389 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 24 to test-NodeB-18592: null 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 22 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #31, conn_id=0) 14:54:28,389 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} [sender=test-NodeD-25447] 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=348 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=56, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}}. 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #56, conn_id=0) 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 sending request 26 to test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeB-18592: #10, conn_id=1) 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 sending request 23 to test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 --> DATA(test-NodeB-18592: #11, conn_id=1) 14:54:28,389 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t3) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=PUT_FOR_STATE_TRANSFER, L1 invalidation=false 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #10, conn_id=1) 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#10 14:54:28,389 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 30 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,389 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#29 14:54:28,389 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 188 of cache opt-cache 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 6 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 221 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 221 of cache opt-cache 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 5 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 252 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 252 of cache opt-cache 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 4 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Applying new state chunk for segment 253 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Finished applying chunk of segment 253 of cache opt-cache 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Latch 3 14:54:28,390 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t1) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #31, conn_id=0) 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #21, conn_id=2) 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#56 14:54:28,389 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#9 14:54:28,390 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 195 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 195 of cache opt-cache 14:54:28,390 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} 14:54:28,390 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#31 14:54:28,390 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Starting outbound transfer to node test-NodeD-25447 for cache opt-cache, topology id 16, segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received request 29 from test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,390 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Adding outbound transfer to test-NodeD-25447 for segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,390 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} [sender=test-NodeB-18592] 14:54:28,390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 23 from test-NodeB-18592: SuccessfulResponse({MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}) 14:54:28,390 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-15,test-NodeD-25447) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,390 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=167 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, finishedSegments={}, unfinishedSegments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@6b97594a[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,390 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t6) Sending last chunk to node test-NodeD-25447 containing 1 cache entries from segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,390 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,390 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 29 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 16 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 16 of cache ___defaultcache 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 25 14:54:28,390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 sending request 31 to test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,390 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 --> DATA(test-NodeD-25447: #11, conn_id=2) 14:54:28,390 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,390 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=258 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 192 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 191 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:28,390 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=509 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 25 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,390 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #11, conn_id=1) 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 192 of cache opt-cache 14:54:28,390 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#11 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 1 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 29 of cache ___defaultcache 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 19 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 24 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 28 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 31 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 28 of cache ___defaultcache 14:54:28,390 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} is {test-NodeD-25447=SuccessfulResponse(null), test-NodeB-18592=SuccessfulResponse({MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}), test-NodeC-10992=CacheNotFoundResponse} 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 23 14:54:28,390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 23 from test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,390 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-thread-test-NodeA-p135-t3) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, new value=init-value 14:54:28,390 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 22 to test-NodeD-25447: SuccessfulResponse(null) 14:54:28,391 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} [sender=test-NodeD-25447] 14:54:28,391 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-thread-test-NodeA-p135-t3) Store MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} in container 14:54:28,390 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received response for request 24 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,391 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-15,test-NodeB-18592) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 2 14:54:28,391 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-9,test-NodeB-18592) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,390 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,391 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,391 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #21, conn_id=2) 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeD-25447: #12, conn_id=2) 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 5 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t3) Committed key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 31 of cache ___defaultcache 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 30 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 22 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 32 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 19 of cache ___defaultcache 14:54:28,391 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Can release resources for transaction GlobalTx:test-NodeA-55522:16? true. Transaction info=null 14:54:28,390 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 191 of cache opt-cache 14:54:28,391 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-thread-test-NodeA-p135-t3) Release locks for keys=[]. owner=GlobalTx:test-NodeA-55522:16 14:54:28,390 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,390 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #11, conn_id=2) 14:54:28,391 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeA-p135-t3) Clearing locked keys: [] 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#11 14:54:28,391 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished receiving state for segments {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 41 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 21 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 32 of cache ___defaultcache 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Inbound transfer finished: InboundTransferTask{segments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, finishedSegments={6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@348dcced[Completed normally], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 83 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Removing inbound transfers from node {6-7 18 39 45-49 55 81-82 137 142-143 188 191-192 195 221 252-253} for segments test-NodeA-55522 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 83 of cache ___defaultcache 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 20 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 30 of cache ___defaultcache 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 15 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 19 14:54:28,391 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (jgroups-15,test-NodeA-55522) Current topology 16, command topology 16 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 89 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 5 of cache ___defaultcache 14:54:28,391 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,391 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,391 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,391 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 sending request 32 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 --> DATA(test-NodeD-25447: #13, conn_id=2) 14:54:28,391 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 58 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,391 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 58 of cache ___defaultcache 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #12, conn_id=2) 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#12 14:54:28,391 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t3) Completed outbound transfer to node test-NodeA-55522, segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,391 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received response for request 22 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#21 14:54:28,391 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=167 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 19 14:54:28,391 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=16, segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,391 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 31 from test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,391 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, finishedSegments={}, unfinishedSegments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@477d2ad9[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,391 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} [sender=test-NodeB-18592] 14:54:28,391 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeD-25447) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,391 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 20 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 89 of cache ___defaultcache 14:54:28,391 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 92 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 15 of cache ___defaultcache 14:54:28,391 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeA-p135-t3) Removed LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000011,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000011}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@10 from transaction table. 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 18 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 19 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 19 of cache opt-cache 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 25 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 101 of cache opt-cache from node test-NodeB-18592: received 1 cache entries 14:54:28,391 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeD-p159-t1) Created a new local transaction: LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@11 14:54:28,391 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Invoked with command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@306a6db6] 14:54:28,392 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, successful=true, topologyId=-1}, origin null 14:54:28,392 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Setting command topology to 16 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Transaction.enlistResource(TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@11}) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012} 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) XaResource.start() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012} 14:54:28,392 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (stateTransferExecutor-thread-test-NodeD-p159-t1) start called on tx GlobalTx:test-NodeD-25447:17 14:54:28,392 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Exists in context? null 14:54:28,392 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Retrieved from container null 14:54:28,392 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:28,392 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Updated context entry null -> VersionedRepeatableReadEntry(7568f5df){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,392 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Invoking: PutKeyValueCommand 14:54:28,392 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) The return value is null 14:54:28,392 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Release locks for keys=[]. owner=CommandInvocation:local:0 14:54:28,392 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeD-p159-t1) Clearing locked keys: [] 14:54:28,392 TRACE [org.infinispan.transaction.impl.LocalTransaction] (stateTransferExecutor-thread-test-NodeD-p159-t1) Adding modification PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, successful=true, topologyId=16}. Mod list is null 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Transaction.commit() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012} 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) runPrepare() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012} 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) XAResource.end() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@11} 14:54:28,392 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (stateTransferExecutor-thread-test-NodeD-p159-t1) end called on tx GlobalTx:test-NodeD-25447:17(opt-cache) 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) XaResource.prepare() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@11} 14:54:28,392 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-thread-test-NodeD-p159-t1) Sending prepare command through the chain: VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeD-25447:17, cacheName='opt-cache'} 14:54:28,392 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Invoked with command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeD-25447:17, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@5f667982] 14:54:28,392 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) handleTxCommand for command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeD-25447:17, cacheName='opt-cache'}, origin null 14:54:28,392 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Setting command topology to 16 14:54:28,392 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Invoking: VersionedPrepareCommand 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) runCommit(forceRollback=false) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012} 14:54:28,392 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) XaResource.commit() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@11} 14:54:28,392 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-thread-test-NodeD-p159-t1) Committing transaction GlobalTx:test-NodeD-25447:17 14:54:28,392 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeD-25447:17, cacheName='opt-cache', topologyId=-1, updatedVersions=null} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@44d70755] 14:54:28,392 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeD-25447:17, cacheName='opt-cache', topologyId=-1, updatedVersions=null}, origin null 14:54:28,392 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Setting command topology to 16 14:54:28,392 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) Invoking: VersionedCommitCommand 14:54:28,392 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-thread-test-NodeD-p159-t1) About to commit entry VersionedRepeatableReadEntry(7568f5df){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,392 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=PUT_FOR_STATE_TRANSFER, L1 invalidation=false 14:54:28,392 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-thread-test-NodeD-p159-t1) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}, new value=init-value 14:54:28,392 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-thread-test-NodeD-p159-t1) Store MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} in container 14:54:28,392 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Committed key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 14:54:28,392 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Can release resources for transaction GlobalTx:test-NodeD-25447:17? true. Transaction info=null 14:54:28,392 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Release locks for keys=[]. owner=GlobalTx:test-NodeD-25447:17 14:54:28,392 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeD-p159-t1) Clearing locked keys: [] 14:54:28,392 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeD-p159-t1) Removed LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000012,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000012}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=16, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@11 from transaction table. 14:54:28,392 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeD-p159-t1) Transaction GlobalTx:test-NodeD-25447:17 has completed, notifying listening threads. 14:54:28,393 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeD-p159-t1) Committed in onePhase? false isOptimistic? true 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 101 of cache opt-cache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 24 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 41 of cache ___defaultcache 14:54:28,391 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t2) Completed outbound transfer to node test-NodeD-25447, segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 17 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 17 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 28 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 16 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 28 of cache opt-cache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 23 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 92 of cache ___defaultcache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 31 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 30 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,391 TRACE [org.infinispan.interceptors.distribution.TxDistributionInterceptor] (jgroups-15,test-NodeA-55522) Ignoring response from node not targeted test-NodeC-10992 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 18 14:54:28,391 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 59 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,391 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #13, conn_id=2) 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 59 of cache ___defaultcache 14:54:28,393 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#13 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 30 of cache opt-cache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t3) Removing completed outbound transfer of segments to test-NodeA-55522 for cache ___defaultcache, segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 16 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 31 of cache opt-cache 14:54:28,393 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with 3 handlers 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 29 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeA-p135-t3) Transaction GlobalTx:test-NodeA-55522:16 has completed, notifying listening threads. 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 29 of cache opt-cache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 20 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 16 of cache opt-cache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 19 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 101 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with 0 handlers 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 159 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 21 14:54:28,393 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 26 from test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,393 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 32 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 41 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with 1 handlers 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 22 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 16 14:54:28,393 TRACE [org.infinispan.commons.tx.TransactionImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) runCommit(forceRollback=false) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010} 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 97 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 99 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 76 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 83 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 41 of cache opt-cache 14:54:28,393 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} [sender=test-NodeA-55522] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 89 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 159 of cache ___defaultcache 14:54:28,393 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} [sender=test-NodeB-18592] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 15 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 162 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 162 of cache ___defaultcache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 14 14:54:28,393 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,393 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Starting outbound transfer to node test-NodeA-55522 for cache ___defaultcache, topology id 16, segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,393 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Adding outbound transfer to test-NodeA-55522 for segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 26 to test-NodeA-55522: SuccessfulResponse(null) 14:54:28,394 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t5) Sending last chunk to node test-NodeA-55522 containing 0 cache entries from segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #30, conn_id=0) 14:54:28,394 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,394 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 sending request 24 to test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 --> DATA(test-NodeA-55522: #31, conn_id=0) 14:54:28,393 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeA-p135-t3) Committed in onePhase? false isOptimistic? true 14:54:28,394 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t2) Removing completed outbound transfer of segments to test-NodeD-25447 for cache opt-cache, segments [2, 3, 8, 42, 75, 90, 91, 111, 112, 113, 138, 158, 173, 177, 227, 230, 244, 254] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 163 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,393 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 107 of cache opt-cache 14:54:28,394 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=30, TP: [cluster_name=ISPN] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 89 of cache opt-cache 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #30, conn_id=0) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 17 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#30 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 18 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 159 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,393 TRACE [org.infinispan.commons.tx.TransactionImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) XaResource.commit() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010}} LocalTransaction{remoteLockedNodes=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f} 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 83 of cache opt-cache 14:54:28,394 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Committing transaction GlobalTx:test-NodeA-55522:15 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 16 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 76 of cache ___defaultcache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 99 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=-1, updatedVersions=null} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6ff3f1a0] 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 97 of cache ___defaultcache 14:54:28,393 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 98 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=-1, updatedVersions=null}, origin null 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 15 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 159 of cache opt-cache 14:54:28,394 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 26 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Starting outbound transfer to node test-NodeB-18592 for cache opt-cache, topology id 16, segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 92 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=248 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,394 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,394 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished receiving state for segments {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 163 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Inbound transfer finished: InboundTransferTask{segments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}, finishedSegments={40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@1a68151c[Completed normally], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 13 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, finishedSegments={}, unfinishedSegments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7d6f3326[Not completed], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 101 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 168 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Removing inbound transfers from node {40 50 54 57 65-66 80 86 107 132 136 174-175 189 193 196 218 225-226 246-247} for segments test-NodeB-18592 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #31, conn_id=0) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Adding outbound transfer to test-NodeB-18592 for segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 92 of cache opt-cache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 13 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 32 to test-NodeB-18592: SuccessfulResponse(null) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 108 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 108 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 12 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) After applying the received state the data container of cache opt-cache has 1 keys 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 109 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 109 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Segments not received yet for cache opt-cache: {test-NodeD-25447=[InboundTransferTask{segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, finishedSegments={}, unfinishedSegments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@669be8c0[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache}]} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Setting command topology to 16 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 14 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 sending response for request 28 to test-NodeB-18592: null 14:54:28,394 TRACE [org.infinispan.interceptors.distribution.VersionedDistributionInterceptor] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 14 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 11 14:54:28,394 TRACE [org.infinispan.transaction.impl.LocalTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) getCommitNodes recipients=[test-NodeB-18592, test-NodeD-25447, test-NodeA-55522], currentTopologyId=16, members=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], txTopologyId=13 14:54:28,394 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 139 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.transaction.impl.LocalTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) The merged list of nodes to send commit/rollback is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 139 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,394 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t6) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 0 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeB-18592: #12, conn_id=1) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 100 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 15 14:54:28,394 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#31 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 168 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 165 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 12 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 165 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 164 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 11 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 24 from test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 174 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 sending request 25 to test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 180 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 --> DATA(test-NodeB-18592: #13, conn_id=1) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 180 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 9 14:54:28,394 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 164 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 184 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 100 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 invoking VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} to recipient list [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:28,394 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 sending request 27 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 10 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 140 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 162 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 --> DATA(test-NodeB-18592: #32, conn_id=0) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 98 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 162 of cache opt-cache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 8 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 140 of cache ___defaultcache 14:54:28,394 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #22, conn_id=2) 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 9 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 184 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 181 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 8 14:54:28,394 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,394 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} [sender=test-NodeD-25447] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeA-55522) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,395 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 sending request 28 to [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992]: VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 174 of cache ___defaultcache 14:54:28,394 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 10 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeB-18592: #33, conn_id=0) 14:54:28,395 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 181 of cache ___defaultcache 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 7 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 7 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Applying new state chunk for segment 245 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Finished applying chunk of segment 245 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 166 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 144 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 144 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 6 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 141 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=392 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 13 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #33, conn_id=0) 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 163 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#33 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 163 of cache opt-cache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 141 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 12 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=161 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #22, conn_id=2) 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 166 of cache ___defaultcache 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 5 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Latch 5 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #32, conn_id=0) 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeD-25447: #23, conn_id=2) 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 178 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 197 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 197 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 3 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 6 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 4 14:54:28,395 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 28 from test-NodeA-55522: VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 178 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute CacheRpcCommand: VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} [sender=test-NodeA-55522] 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#32 14:54:28,395 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 28 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeC-10992: #18, conn_id=1) 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#22 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 248 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 164 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 164 of cache opt-cache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 11 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 168 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 168 of cache opt-cache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 10 14:54:28,395 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t4) Completed outbound transfer to node test-NodeA-55522, segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 174 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 3 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 165 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 249 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 250 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 248 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 27 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,395 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=392 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} [sender=test-NodeA-55522] 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #23, conn_id=2) 14:54:28,395 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,395 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} 14:54:28,395 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Starting outbound transfer to node test-NodeA-55522 for cache opt-cache, topology id 16, segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,395 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Adding outbound transfer to test-NodeA-55522 for segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,395 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 27 to test-NodeA-55522: SuccessfulResponse(null) 14:54:28,396 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #32, conn_id=0) 14:54:28,396 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t2) Sending last chunk to node test-NodeA-55522 containing 0 cache entries from segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,395 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-15,test-NodeB-18592) [Notifier] Checking command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}}. 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 4 14:54:28,396 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-15,test-NodeB-18592) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,396 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 198 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 198 of cache ___defaultcache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 2 14:54:28,396 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 sending request 26 to test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,396 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 --> DATA(test-NodeA-55522: #33, conn_id=0) 14:54:28,396 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,396 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t5) Calling perform() on VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:28,396 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=242 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 44 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #33, conn_id=0) 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 44 of cache ___defaultcache 14:54:28,396 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#33 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 222 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 183 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:28,396 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 26 from test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,395 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#23 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 2 14:54:28,396 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} [sender=test-NodeD-25447] 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 250 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 249 of cache ___defaultcache 14:54:28,395 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t4) Removing completed outbound transfer of segments to test-NodeA-55522 for cache opt-cache, segments [40, 50, 54, 57, 65, 66, 80, 86, 107, 132, 136, 174, 175, 189, 193, 196, 218, 225, 226, 246, 247] 14:54:28,396 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished receiving state for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 174 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 165 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Inbound transfer finished: InboundTransferTask{segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, finishedSegments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@de2264b[Completed normally], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 1 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Removing inbound transfers from node {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} for segments test-NodeB-18592 14:54:28,396 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeA-55522) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 183 of cache ___defaultcache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 1 14:54:28,396 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished receiving of segments for cache ___defaultcache for topology 16. 14:54:28,396 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 222 of cache ___defaultcache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Before applying the received state the data container of cache opt-cache has 1 keys 14:54:28,396 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished receiving state for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 19 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 36 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 36 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-thread-test-NodeB-p138-t5) About to execute tx command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 19 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 37 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 44 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 37 of cache ___defaultcache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 44 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 18 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 58 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 36 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 18 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 37 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 85 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 85 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 17 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Inbound transfer finished: InboundTransferTask{segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, finishedSegments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@6b97594a[Completed normally], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Removing inbound transfers from node {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} for segments test-NodeD-25447 14:54:28,396 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeB-p138-t5) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:28,396 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,396 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished receiving of segments for cache ___defaultcache for topology 16. 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,396 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 28 from test-NodeA-55522: VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:28,396 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeB-p138-t5) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}}, origin test-NodeA-55522 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 8 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 9 14:54:28,396 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} [sender=test-NodeA-55522] 14:54:28,396 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 184 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 181 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 108 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 108 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 37 of cache opt-cache 14:54:28,396 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #32, conn_id=0) 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 58 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#32 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 36 of cache ___defaultcache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 58 of cache ___defaultcache 14:54:28,396 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 27 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 58 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 16 14:54:28,397 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=16, segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 110 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 14 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 110 of cache opt-cache 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 181 of cache opt-cache 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 13 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 184 of cache opt-cache 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 114 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,396 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t3) Tracking is disabled. Clear tracker: {} 14:54:28,397 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=252 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 180 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,397 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #13, conn_id=1) 14:54:28,396 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeD-25447) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 197 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,397 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,397 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:28,397 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-thread-test-NodeD-p154-t4) About to execute tx command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:28,397 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeD-p154-t4) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:28,397 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeD-p154-t4) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}}, origin test-NodeA-55522 14:54:28,397 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeD-p154-t4) Remote tx topology id 16 and command topology is 16 14:54:28,397 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeD-p154-t4) Invoking: VersionedCommitCommand 14:54:28,397 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-thread-test-NodeD-p154-t4) About to commit entry VersionedRepeatableReadEntry(9e1b501){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:28,397 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeD-p154-t4) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=null, L1 invalidation=false 14:54:28,397 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeD-p154-t4) Creating new ICE for writing. Existing=MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, new value=final-value 14:54:28,397 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeD-p154-t4) Store MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} in container 14:54:28,397 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeD-p154-t4) Committed key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Old discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 14:54:28,398 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeD-p154-t4) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(9e1b501){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,398 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 28 to test-NodeA-55522: SuccessfulResponse(null) 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #34, conn_id=0) 14:54:28,398 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:28,396 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeB-p138-t5) Remote tx topology id 16 and command topology is 16 14:54:28,397 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,398 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeB-p138-t5) Invoking: VersionedCommitCommand 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #12, conn_id=1) 14:54:28,398 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#12 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #34, conn_id=0) 14:54:28,398 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received response for request 32 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 197 of cache opt-cache 14:54:28,397 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#13 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 180 of cache opt-cache 14:54:28,398 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=16, segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,397 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=392 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,397 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,398 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #57, conn_id=0) 14:54:28,398 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 25 from test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,398 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=57, TP: [cluster_name=ISPN] 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 114 of cache opt-cache 14:54:28,397 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Tracking is disabled. Clear tracker: {} 14:54:28,397 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 6 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 0 14:54:28,398 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=57, TP: [cluster_name=ISPN] 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #57, conn_id=0) 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Segments not received yet for cache ___defaultcache: {} 14:54:28,398 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 23 to test-NodeD-25447: null 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeD-25447: #14, conn_id=2) 14:54:28,398 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 5 14:54:28,397 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 15 14:54:28,396 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 17 14:54:28,398 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#57 14:54:28,398 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,398 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,398 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} [sender=test-NodeD-25447] 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, finishedSegments={36-37 44 58 85 108 110 114}, unfinishedSegments={115 124-125 131 134-135 145-146 217 222-223 229}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@669be8c0[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 12 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, finishedSegments={}, unfinishedSegments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@433a99bb[Not completed], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,399 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true}. 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 0 14:54:28,398 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) null: dropping message from test-NodeA-55522 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) After applying the received state the data container of cache opt-cache has 2 keys 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 124 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 124 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 4 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 7 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 131 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 131 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Applying new state chunk for segment 250 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#34 14:54:28,398 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-thread-test-NodeB-p138-t5) About to commit entry VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,399 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 28 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Finished applying chunk of segment 250 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Applying new state chunk for segment 248 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 10 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Applying new state chunk for segment 245 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 11 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Segments not received yet for cache opt-cache: {test-NodeD-25447=[InboundTransferTask{segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, finishedSegments={}, unfinishedSegments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@433a99bb[Not completed, 1 dependents], topologyId=16, timeout=240000, cacheName=opt-cache}]} 14:54:28,399 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeB-18592) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,399 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 sending response for request 24 to test-NodeA-55522: null 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 125 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #58, conn_id=0) 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 115 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 134 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeB-18592] 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Before applying the received state the data container of cache opt-cache has 2 keys 14:54:28,398 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 --> DATA(test-NodeA-55522: #35, conn_id=0) 14:54:28,398 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 16 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 5 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 59 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 59 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 5 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 20 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 32 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 76 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 32 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 76 of cache opt-cache 14:54:28,399 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 18 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 134 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 9 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 135 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,399 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=58, TP: [cluster_name=ISPN] 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 115 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 125 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 8 14:54:28,399 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,399 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeB-p138-t5) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=null, L1 invalidation=false 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Finished applying chunk of segment 245 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t2) Latch 2 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Finished applying chunk of segment 248 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Latch 3 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t3) Latch 1 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 249 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 249 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 85 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 7 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 15 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeB-18592, topology id = 16 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 135 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 58 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 6 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 97 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Applying new state chunk for segment 217 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 145 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=___defaultcache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 16 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 145 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 5 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 0 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t6) Segments not received yet for cache ___defaultcache: {} 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 19 14:54:28,399 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #14, conn_id=2) 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 108 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 17 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 110 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#14 14:54:28,399 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 29 to test-NodeB-18592: null 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 108 of cache ___defaultcache 14:54:28,399 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 15 14:54:28,399 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 16@___defaultcache received confirmation for test-NodeB-18592, remaining list is [test-NodeA-55522, test-NodeD-25447] 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 146 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Finished applying chunk of segment 217 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 97 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 16 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 15 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 100 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=58, TP: [cluster_name=ISPN] 14:54:28,399 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished receiving state for segments {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} 14:54:28,399 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeB-p138-t5) Creating new ICE for writing. Existing=MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, new value=final-value 14:54:28,399 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #58, conn_id=0) 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 100 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 15 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 98 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 99 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 58 of cache opt-cache 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Latch 4 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 13 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 146 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 3 14:54:28,399 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 23 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 110 of cache ___defaultcache 14:54:28,400 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #35, conn_id=0) 14:54:28,400 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeB-18592: #14, conn_id=1) 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 99 of cache opt-cache 14:54:28,400 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#35 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 98 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 222 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeB-p138-t5) Store MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} in container 14:54:28,400 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 14 14:54:28,400 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeB-p138-t5) Committed key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 108 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,399 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#58 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Inbound transfer finished: InboundTransferTask{segments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, finishedSegments={16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@477d2ad9[Completed normally], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,399 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 85 of cache ___defaultcache 14:54:28,400 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 24 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Removing inbound transfers from node {16 19 28-31 41 83 89 92 101 159 162-165 168 174 180-181 184 197 245 248-250} for segments test-NodeB-18592 14:54:28,400 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-thread-test-NodeB-p138-t5) About to commit entry VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 108 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 229 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished receiving of segments for cache opt-cache for topology 16. 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 229 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 109 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeB-p138-t5) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=null, L1 invalidation=false 14:54:28,400 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t4) Completed outbound transfer to node test-NodeB-18592, segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 139 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t4) Removing completed outbound transfer of segments to test-NodeB-18592 for cache ___defaultcache, segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 222 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Applying new state chunk for segment 223 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 1 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 11 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 14 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 10 14:54:28,400 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeD-25447] 14:54:28,400 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,400 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeB-p138-t5) Creating new ICE for writing. Existing=MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, new value=final-value 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 139 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 109 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 9 14:54:28,400 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 144 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 144 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 2 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 8 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 12 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 166 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 166 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 7 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Applying new state chunk for segment 183 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,400 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=16, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 13 14:54:28,400 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #14, conn_id=1) 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 178 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 141 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Finished applying chunk of segment 183 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t4) Tracking is disabled. Clear tracker: {MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 140 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeB-p138-t5) Store MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} in container 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished applying chunk of segment 223 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,400 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished receiving state for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,400 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeB-p138-t5) Committed key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 115 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Inbound transfer finished: InboundTransferTask{segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, finishedSegments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@669be8c0[Completed normally], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 114 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeD-25447, topology id = 16 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 115 of cache ___defaultcache 14:54:28,400 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,400 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #36, conn_id=0) 14:54:28,400 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=___defaultcache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 16 14:54:28,400 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 16@___defaultcache received confirmation for test-NodeD-25447, remaining list is [test-NodeA-55522] 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 5 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 140 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 4 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Latch 6 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 141 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeB-p138-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 198 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 178 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Applying new state chunk for segment 222 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#14 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Finished applying chunk of segment 222 of cache opt-cache 14:54:28,400 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t4) Completed outbound transfer to node test-NodeB-18592, segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t1) Latch 2 14:54:28,400 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 28 to test-NodeA-55522: SuccessfulResponse(null) 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 3 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 198 of cache opt-cache 14:54:28,400 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeA-55522: #59, conn_id=0) 14:54:28,400 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 1 14:54:28,400 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster_name=ISPN] 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 12 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 114 of cache ___defaultcache 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 11 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 124 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 124 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 10 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Removing inbound transfers from node {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} for segments test-NodeD-25447 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 125 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=59, TP: [cluster_name=ISPN] 14:54:28,401 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Finished receiving of segments for cache opt-cache for topology 16. 14:54:28,400 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 131 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 131 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 9 14:54:28,401 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished receiving state for segments {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 145 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 145 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 8 14:54:28,400 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 29 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 134 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 134 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 7 14:54:28,401 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,401 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:28,401 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t5) Completed outbound transfer to node test-NodeD-25447, segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #36, conn_id=0) 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 135 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) After applying the received state the data container of cache opt-cache has 1 keys 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 0 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Segments not received yet for cache opt-cache: {} 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 146 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Inbound transfer finished: InboundTransferTask{segments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, finishedSegments={5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@433a99bb[Completed normally], topologyId=16, timeout=240000, cacheName=opt-cache} 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 146 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 6 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #59, conn_id=0) 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 222 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 217 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#59 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 125 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 28 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 217 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 4 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 222 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 3 14:54:28,401 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 31 to test-NodeB-18592: null 14:54:28,401 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Applying new state chunk for segment 229 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Applying new state chunk for segment 223 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:28,401 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t1) Tracking is disabled. Clear tracker: {MagicKey#k1{8/537A1109/107@test-NodeB-18592}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}} 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Finished applying chunk of segment 223 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t2) Latch 2 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 135 of cache ___defaultcache 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t1) Latch 0 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#36 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) After applying the received state the data container of cache opt-cache has 1 keys 14:54:28,401 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t5) Removing completed outbound transfer of segments to test-NodeD-25447 for cache ___defaultcache, segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,401 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t4) Removing completed outbound transfer of segments to test-NodeB-18592 for cache opt-cache, segments [6, 7, 18, 39, 45, 46, 47, 48, 49, 55, 81, 82, 137, 142, 143, 188, 191, 192, 195, 221, 252, 253] 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Segments not received yet for cache opt-cache: {} 14:54:28,401 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,401 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 sending response for request 26 to test-NodeD-25447: null 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 1 14:54:28,401 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 16 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Removing inbound transfers from node {5 15 32 58-59 76 97-100 108-109 139-141 144 166 178 183 198 222} for segments test-NodeD-25447 14:54:28,401 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} is {test-NodeD-25447=SuccessfulResponse(null), test-NodeB-18592=SuccessfulResponse(null), test-NodeC-10992=CacheNotFoundResponse} 14:54:28,401 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,401 TRACE [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] (jgroups-15,test-NodeA-55522) Current topology 16, command topology 16 14:54:28,401 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 16 14:54:28,401 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeD-25447] 14:54:28,401 TRACE [org.infinispan.interceptors.distribution.TxDistributionInterceptor] (jgroups-15,test-NodeA-55522) Ignoring response from node not targeted test-NodeC-10992 14:54:28,401 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t5) Rebalance confirmation collector 16@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished applying chunk of segment 229 of cache ___defaultcache 14:54:28,401 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 16 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 5 14:54:28,401 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (remote-thread-test-NodeA-p130-t4) Finished receiving state for segments {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} 14:54:28,401 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,401 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished receiving of segments for cache opt-cache for topology 16. 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Inbound transfer finished: InboundTransferTask{segments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, finishedSegments={36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7d6f3326[Completed normally], topologyId=16, timeout=240000, cacheName=___defaultcache} 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,401 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Removing inbound transfers from node {36-37 44 58 85 108 110 114-115 124-125 131 134-135 145-146 217 222-223 229} for segments test-NodeD-25447 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 --> DATA(test-NodeD-25447: #24, conn_id=2) 14:54:28,401 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,401 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 16 14:54:28,401 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,401 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (jgroups-15,test-NodeA-55522) Resuming invocation of command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} with 7 handlers 14:54:28,401 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t3) Tracking is disabled. Clear tracker: {MagicKey#k1{8/537A1109/107@test-NodeB-18592}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}} 14:54:28,401 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-15,test-NodeA-55522) About to commit entry VersionedRepeatableReadEntry(3dde1020){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,401 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #24, conn_id=2) 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#24 14:54:28,401 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (jgroups-15,test-NodeA-55522) About to commit entry VersionedRepeatableReadEntry(3319e833){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:28,401 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 26 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,401 TRACE [org.infinispan.statetransfer.CommitManager] (jgroups-15,test-NodeA-55522) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=null, L1 invalidation=false 14:54:28,401 TRACE [org.infinispan.statetransfer.CommitManager] (jgroups-15,test-NodeA-55522) Committing key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:28,401 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,401 TRACE [org.infinispan.container.DefaultDataContainer] (jgroups-15,test-NodeA-55522) Creating new ICE for writing. Existing=MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, new value=final-value 14:54:28,401 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t2) Completed outbound transfer to node test-NodeA-55522, segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,401 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeB-18592: #15, conn_id=1) 14:54:28,401 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t2) Removing completed outbound transfer of segments to test-NodeA-55522 for cache opt-cache, segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,401 TRACE [org.infinispan.container.DefaultDataContainer] (jgroups-15,test-NodeA-55522) Store MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} in container 14:54:28,401 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,401 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,401 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 16@opt-cache received confirmation for test-NodeD-25447, remaining list is [test-NodeB-18592] 14:54:28,401 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Finished receiving of segments for cache ___defaultcache for topology 16. 14:54:28,402 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (jgroups-15,test-NodeA-55522) Can release resources for transaction GlobalTx:test-NodeA-55522:15? true. Transaction info=null 14:54:28,402 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #60, conn_id=0) 14:54:28,402 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-15,test-NodeA-55522) Release locks for keys=[]. owner=GlobalTx:test-NodeA-55522:15 14:54:28,402 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeA-p130-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=60, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-15,test-NodeA-55522) Clearing locked keys: [] 14:54:28,402 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeA-p130-t4) Tracking is disabled. Clear tracker: {} 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #15, conn_id=1) 14:54:28,402 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 0 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#15 14:54:28,402 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Latch 0 14:54:28,402 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,402 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) After applying the received state the data container of cache opt-cache has 2 keys 14:54:28,402 TRACE [org.infinispan.transaction.impl.TransactionTable] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Changing minimum topology ID from 13 to 16 14:54:28,402 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Segments not received yet for cache opt-cache: {} 14:54:28,402 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeA-55522, topology id = 16 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=60, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #60, conn_id=0) 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 31 from test-NodeD-25447: SuccessfulResponse(null) 14:54:28,402 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) [Context=___defaultcache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 16 14:54:28,402 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Segments not received yet for cache ___defaultcache: {} 14:54:28,402 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t1) Rebalance confirmation collector 16@___defaultcache received confirmation for test-NodeA-55522, remaining list is [] 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 25 to test-NodeD-25447: null 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 24 to test-NodeD-25447: null 14:54:28,402 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t1) ISPN000336: Finished cluster-wide rebalance for cache ___defaultcache, topology id = 16 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#60 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeD-25447: #15, conn_id=2) 14:54:28,402 TRACE [org.infinispan.transaction.impl.TransactionTable] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Removed LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000010,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000010}} LocalTransaction{remoteLockedNodes=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992], isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], topologyId=13, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@f from transaction table. 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Transaction GlobalTx:test-NodeA-55522:15 has completed, notifying listening threads. 14:54:28,402 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeA-p132-t1) Cache ___defaultcache topology updated: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,402 TRACE [org.infinispan.transaction.impl.TransactionTable] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Committed in onePhase? false isOptimistic? true 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #25, conn_id=2) 14:54:28,402 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=16, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=16, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeB-18592] 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #15, conn_id=2) 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,402 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 16 14:54:28,402 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Can release resources for transaction GlobalTx:test-NodeA-55522:15? true. Transaction info=null 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#15 14:54:28,402 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t6) Completed outbound transfer to node test-NodeD-25447, segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,402 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,402 TRACE [org.infinispan.transaction.impl.LocalTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) getCommitNodes recipients=[test-NodeB-18592, test-NodeD-25447, test-NodeA-55522], currentTopologyId=16, members=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], txTopologyId=13 14:54:28,402 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t6) Removing completed outbound transfer of segments to test-NodeD-25447 for cache opt-cache, segments [16, 19, 28, 29, 30, 31, 41, 83, 89, 92, 101, 159, 162, 163, 164, 165, 168, 174, 180, 181, 184, 197, 245, 248, 249, 250] 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 25 from test-NodeB-18592: SuccessfulResponse(null) 14:54:28,402 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 16 14:54:28,402 TRACE [org.infinispan.transaction.impl.LocalTransaction] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) The merged list of nodes to send commit/rollback is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,402 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 16@opt-cache received confirmation for test-NodeB-18592, remaining list is [] 14:54:28,402 TRACE [org.infinispan.transaction.impl.TransactionTable] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) About to invoke tx completion notification on commitNodes: [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:28,402 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000336: Finished cluster-wide rebalance for cache opt-cache, topology id = 16 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #25, conn_id=2) 14:54:28,402 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} to recipient list [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 14:54:28,402 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Topology id missing on command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} , setting it to 16 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#25 14:54:28,402 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache opt-cache topology updated: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,402 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:28,402 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 sending command to [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992]: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received response for request 24 from test-NodeA-55522: SuccessfulResponse(null) 14:54:28,402 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,402 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t6) Completed outbound transfer to node test-NodeB-18592, segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeB-18592: #34, conn_id=0) 14:54:28,402 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-8,test-NodeD-25447) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=16, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t1) Initialized topology confirmation collector 17@___defaultcache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,402 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,402 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t5) Completed outbound transfer to node test-NodeA-55522, segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,402 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 17@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,402 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #34, conn_id=0) 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#34 14:54:28,402 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:28,402 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,402 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} [sender=test-NodeA-55522] 14:54:28,402 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522: sending test-NodeA-55522#45 14:54:28,402 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} . 14:54:28,402 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=45], TP: [cluster_name=ISPN] 14:54:28,402 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeB-18592) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,402 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,402 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:28,402 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeB-p138-t4) Processing completed transaction GlobalTx:test-NodeA-55522:15 14:54:28,403 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 used 6030 credits, 1816724 remaining 14:54:28,402 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t6) Removing completed outbound transfer of segments to test-NodeB-18592 for cache opt-cache, segments [5, 15, 32, 58, 59, 76, 97, 98, 99, 100, 108, 109, 139, 140, 141, 144, 166, 178, 183, 198, 222] 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6030 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=45], TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6030 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=45], TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#45 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#45 14:54:28,403 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t4) Removed remote transaction GlobalTx:test-NodeA-55522:15 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,403 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t4) Changing minimum topology ID from 13 to 16 14:54:28,403 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,403 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,403 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,403 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t4) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(1545e9c2){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(303e5f36){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}], backupKeyLocks=[], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} from transaction table. 14:54:28,403 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeB-p138-t4) Transaction GlobalTx:test-NodeA-55522:15 has completed, notifying listening threads. 14:54:28,403 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t4) Marking transaction GlobalTx:test-NodeA-55522:15 as completed 14:54:28,403 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,402 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,402 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,402 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t5) Removing completed outbound transfer of segments to test-NodeA-55522 for cache ___defaultcache, segments [36, 37, 44, 58, 85, 108, 110, 114, 115, 124, 125, 131, 134, 135, 145, 146, 217, 222, 223, 229] 14:54:28,402 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeD-25447: #26, conn_id=2) 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=26, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,403 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#46 14:54:28,403 TRACE [org.jgroups.protocols.UNICAST3] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522 --> DATA(test-NodeC-10992: #19, conn_id=1) 14:54:28,403 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Updating local topology for cache opt-cache: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=26, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #26, conn_id=2) 14:54:28,403 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#26 14:54:28,403 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} is {} 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) null: dropping message from test-NodeA-55522 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,403 DEBUG [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (ForkThread-1,OptimisticTxPartitionAndMergeDuringPrepareTest) Exiting fork callable. 14:54:28,403 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeB-p138-t4) Invoking forward of TxCompletionNotification for transaction GlobalTx:test-NodeA-55522:15. Affected keys: [MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}] 14:54:28,403 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 6030 credits, 1865538 remaining 14:54:28,403 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-thread-test-NodeB-p138-t4) CommandTopologyId=16, localTopologyId=16 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#45 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,403 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=46], TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,403 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} [sender=test-NodeA-55522] 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,403 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeD-25447) Checking if transaction data was received for topology 16, current topology is 16 14:54:28,403 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,403 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6024 credits, 1810700 remaining 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6024 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=46], TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:28,403 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeB-p138-t4) Release locks for keys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}]. owner=GlobalTx:test-NodeA-55522:15 14:54:28,403 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeD-p154-t5) Processing completed transaction GlobalTx:test-NodeA-55522:15 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#45 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#46 14:54:28,403 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6024 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=46], TP: [cluster_name=ISPN] 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 36-38 40 44 50-51 54 57-58 60 65-67 69-70 74 80 85-86 93 102 107-108 110 114-117 121-122 124-125 129 131-132 134-136 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-226 229 233-234 236 243 246-247 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {5-7 12 15 18 22 24 27 32 39 45-49 53 55-56 58-59 61 63-64 68 72-73 76-77 79 81-82 88 94-95 97-100 103 105-106 108-109 118-119 126-127 134-135 137 139-144 148 150 154 158 161 166-167 171 178-179 183 188 191-192 195 198 207 211 214 221-222 224 235 240-241 252-253} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-31 34-35 41-43 52 62 71 75 78 83-84 87 89-92 96 101 104 111-113 120 123 128 130 133 138 152-153 155 158-159 162-165 168-170 173-174 177 180-182 184-186 197 200-202 209 212 216 219 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:28,403 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,403 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeD-p154-t5) Removed remote transaction GlobalTx:test-NodeA-55522:15 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(9e1b501){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:28,403 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t2) Installing new cache topology CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,403 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,404 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t2) (isRunning=true) Installed new topology 17: CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling topology 17 is installed 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Topology update processed, stateTransferTopologyId = 16, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,404 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,404 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t2) Tracking is disabled. Clear tracker: {} 14:54:28,404 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@4b9c7f08 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,404 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t2) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} with new topology 17 and was pre false 14:54:28,404 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t2) No change listeners present! 14:54:28,404 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Unlock State Transfer in Progress for topology ID 17 14:54:28,404 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling transaction data received for topology 17 14:54:28,404 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,404 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,404 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,404 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,404 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Topology changed, recalculating minTopologyId 14:54:28,404 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Changing minimum topology ID from 16 to 17 14:54:28,404 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 17 14:54:28,404 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,404 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t5) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 17 14:54:28,404 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) Check if topology CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t5) Rebalance confirmation collector 17@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#46 14:54:28,403 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#46 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,403 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Release lock for GlobalTx:test-NodeA-55522:15. 14:54:28,404 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#46 14:54:28,403 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}. ACQUIRED => RELEASED 14:54:28,404 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,404 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 36-38 40 44 50-51 54 57-58 60 65-67 69-70 74 80 85-86 93 102 107-108 110 114-117 121-122 124-125 129 131-132 134-136 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-226 229 233-234 236 243 246-247 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {5-7 12 15 18 22 24 27 32 39 45-49 53 55-56 58-59 61 63-64 68 72-73 76-77 79 81-82 88 94-95 97-100 103 105-106 108-109 118-119 126-127 134-135 137 139-144 148 150 154 158 161 166-167 171 178-179 183 188 191-192 195 198 207 211 214 221-222 224 235 240-241 252-253} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-31 34-35 41-43 52 62 71 75 78 83-84 87 89-92 96 101 104 111-113 120 123 128 130 133 138 152-153 155 158-159 162-165 168-170 173-174 177 180-182 184-186 197 200-202 209 212 216 219 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:28,404 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeA-55522 used 6030 credits, 1816724 remaining 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}? true 14:54:28,404 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,403 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 36-38 40 44 50-51 54 57-58 60 65-67 69-70 74 80 85-86 93 102 107-108 110 114-117 121-122 124-125 129 131-132 134-136 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-226 229 233-234 236 243 246-247 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {5-7 12 15 18 22 24 27 32 39 45-49 53 55-56 58-59 61 63-64 68 72-73 76-77 79 81-82 88 94-95 97-100 103 105-106 108-109 118-119 126-127 134-135 137 139-144 148 150 154 158 161 166-167 171 178-179 183 188 191-192 195 198 207 211 214 221-222 224 235 240-241 252-253} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-31 34-35 41-43 52 62 71 75 78 83-84 87 89-92 96 101 104 111-113 120 123 128 130 133 138 152-153 155 158-159 162-165 168-170 173-174 177 180-182 184-186 197 200-202 209 212 216 219 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:28,403 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeD-p154-t5) Changing minimum topology ID from 15 to 16 14:54:28,404 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,404 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t6) Installing new cache topology CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,404 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,404 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t3) Installing new cache topology CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,404 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeA-55522 used 6024 credits, 1810700 remaining 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,404 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeD-p154-t5) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(9e1b501){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}}}, lockedKeys=[], backupKeyLocks=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} from transaction table. 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}, null) => true 14:54:28,404 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t3) (isRunning=true) Installed new topology 17: CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Try acquire. Next in queue=null. Current=null 14:54:28,404 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeD-p154-t5) Transaction GlobalTx:test-NodeA-55522:15 has completed, notifying listening threads. 14:54:28,404 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Release lock for GlobalTx:test-NodeA-55522:15. 14:54:28,404 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Updating local topology for cache ___defaultcache: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeD-p154-t5) Marking transaction GlobalTx:test-NodeA-55522:15 as completed 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}. ACQUIRED => RELEASED 14:54:28,404 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}? true 14:54:28,404 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,404 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 6024 credits, 1859514 remaining 14:54:28,404 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling topology 17 is installed 14:54:28,404 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t1) Updating local topology for cache opt-cache: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,404 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15} 14:54:28,405 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t1) Updating local topology for cache opt-cache: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,405 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t6) (isRunning=true) Installed new topology 17: CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:28,405 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}, null) => true 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling topology 17 is installed 14:54:28,405 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeD-p154-t5) Invoking forward of TxCompletionNotification for transaction GlobalTx:test-NodeA-55522:15. Affected keys: [MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}] 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,405 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeB-p138-t4) Try acquire. Next in queue=null. Current=null 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-thread-test-NodeD-p154-t5) CommandTopologyId=16, localTopologyId=16 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Topology update processed, stateTransferTopologyId = 16, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 36-38 40 44 50-51 54 57-58 60 65-67 69-70 74 80 85-86 93 102 107-108 110 114-117 121-122 124-125 129 131-132 134-136 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-226 229 233-234 236 243 246-247 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {5-7 12 15 18 22 24 27 32 39 45-49 53 55-56 58-59 61 63-64 68 72-73 76-77 79 81-82 88 94-95 97-100 103 105-106 108-109 118-119 126-127 134-135 137 139-144 148 150 154 158 161 166-167 171 178-179 183 188 191-192 195 198 207 211 214 221-222 224 235 240-241 252-253} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-31 34-35 41-43 52 62 71 75 78 83-84 87 89-92 96 101 104 111-113 120 123 128 130 133 138 152-153 155 158-159 162-165 168-170 173-174 177 180-182 184-186 197 200-202 209 212 216 219 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:28,405 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeD-p154-t5) Release locks for keys=[]. owner=GlobalTx:test-NodeA-55522:15 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Topology update processed, stateTransferTopologyId = 16, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t6) Tracking is disabled. Clear tracker: {} 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 36-38 40 44 50-51 54 57-58 60 65-67 69-70 74 80 85-86 93 102 107-108 110 114-117 121-122 124-125 129 131-132 134-136 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-226 229 233-234 236 243 246-247 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {5-7 12 15 18 22 24 27 32 39 45-49 53 55-56 58-59 61 63-64 68 72-73 76-77 79 81-82 88 94-95 97-100 103 105-106 108-109 118-119 126-127 134-135 137 139-144 148 150 154 158 161 166-167 171 178-179 183 188 191-192 195 198 207 211 214 221-222 224 235 240-241 252-253} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-31 34-35 41-43 52 62 71 75 78 83-84 87 89-92 96 101 104 111-113 120 123 128 130 133 138 152-153 155 158-159 162-165 168-170 173-174 177 180-182 184-186 197 200-202 209 212 216 219 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@7fb96ae2 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t1) Installing new cache topology CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,405 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t6) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} with new topology 17 and was pre false 14:54:28,405 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t6) No change listeners present! 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@30979069 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Unlock State Transfer in Progress for topology ID 17 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling transaction data received for topology 17 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,405 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t3) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeA-55522, topology id = 17 14:54:28,405 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) Check if topology CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) Installing new cache topology CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,405 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t3) [Context=___defaultcache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 17 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t3) Tracking is disabled. Clear tracker: {} 14:54:28,405 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t1) (isRunning=true) Installed new topology 17: CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t3) Rebalance confirmation collector 17@___defaultcache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling topology 17 is installed 14:54:28,405 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 36-38 40 44 50-51 54 57-58 60 65-67 69-70 74 80 85-86 93 102 107-108 110 114-117 121-122 124-125 129 131-132 134-136 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-226 229 233-234 236 243 246-247 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {5-7 12 15 18 22 24 27 32 39 45-49 53 55-56 58-59 61 63-64 68 72-73 76-77 79 81-82 88 94-95 97-100 103 105-106 108-109 118-119 126-127 134-135 137 139-144 148 150 154 158 161 166-167 171 178-179 183 188 191-192 195 198 207 211 214 221-222 224 235 240-241 252-253} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-31 34-35 41-43 52 62 71 75 78 83-84 87 89-92 96 101 104 111-113 120 123 128 130 133 138 152-153 155 158-159 162-165 168-170 173-174 177 180-182 184-186 197 200-202 209 212 216 219 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@5d629bac passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t2) (isRunning=true) Installed new topology 17: CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling topology 17 is installed 14:54:28,405 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t3) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} with new topology 17 and was pre false 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t1) Installing new cache topology CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,405 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t3) No change listeners present! 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Topology update processed, stateTransferTopologyId = 16, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Topology update processed, stateTransferTopologyId = 16, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@39404c3d passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t1) Tracking is disabled. Clear tracker: {} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Unlock State Transfer in Progress for topology ID 17 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,405 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling transaction data received for topology 17 14:54:28,405 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t2) Tracking is disabled. Clear tracker: {} 14:54:28,405 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@634a99a1 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,405 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 --> DATA(test-NodeA-55522: #37, conn_id=0) 14:54:28,405 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@46b0a97f passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,405 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t1) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} with new topology 17 and was pre false 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:28,406 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t1) (isRunning=true) Installed new topology 17: CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,406 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t1) No change listeners present! 14:54:28,406 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t2) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} with new topology 17 and was pre false 14:54:28,406 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling topology 17 is installed 14:54:28,406 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t2) No change listeners present! 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,406 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@69b2f2d1 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,406 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Unlock State Transfer in Progress for topology ID 17 14:54:28,406 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,406 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) Check if topology CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,406 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Unlock State Transfer in Progress for topology ID 17 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:28,406 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling transaction data received for topology 17 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #37, conn_id=0) 14:54:28,406 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling transaction data received for topology 17 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#37 14:54:28,406 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,406 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Topology update processed, stateTransferTopologyId = 16, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,406 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,406 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,406 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Stop keeping track of changed keys for state transfer in topology 16 14:54:28,406 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeD-25447] 14:54:28,406 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,406 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,406 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,406 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:28,406 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeD-25447, topology id = 17 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 --> DATA(test-NodeA-55522: #61, conn_id=0) 14:54:28,406 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t1) Tracking is disabled. Clear tracker: {} 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 --> DATA(test-NodeA-55522: #62, conn_id=0) 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=61, TP: [cluster_name=ISPN] 14:54:28,406 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=___defaultcache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 17 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=62, TP: [cluster_name=ISPN] 14:54:28,406 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 17@___defaultcache received confirmation for test-NodeD-25447, remaining list is [test-NodeB-18592] 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@33b8274d passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,406 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t1) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} with new topology 17 and was pre false 14:54:28,406 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t1) No change listeners present! 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=61, TP: [cluster_name=ISPN] 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #61, conn_id=0) 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@6342a1e4 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, newTopologyId=17} 14:54:28,406 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) Check if topology CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#61 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,406 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,406 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Topology changed, recalculating minTopologyId 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=62, TP: [cluster_name=ISPN] 14:54:28,406 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t1) Changing minimum topology ID from 16 to 17 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #62, conn_id=0) 14:54:28,406 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Unlock State Transfer in Progress for topology ID 17 14:54:28,406 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeB-18592] 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#62 14:54:28,406 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,406 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling transaction data received for topology 17 14:54:28,406 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,406 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeB-18592, topology id = 17 14:54:28,406 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeB-18592] 14:54:28,406 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,406 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,406 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,406 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 17 14:54:28,406 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=___defaultcache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 17 14:54:28,406 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) Check if topology CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,406 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,406 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 17 14:54:28,406 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 17@___defaultcache received confirmation for test-NodeB-18592, remaining list is [] 14:54:28,406 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Rebalance confirmation collector 17@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeD-25447] 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 --> DATA(test-NodeA-55522: #38, conn_id=0) 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:28,406 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t6) Cache ___defaultcache topology updated: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,406 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:28,406 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,406 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Topology changed, recalculating minTopologyId 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #38, conn_id=0) 14:54:28,406 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Changing minimum topology ID from 16 to 17 14:54:28,406 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#38 14:54:28,406 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,406 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=17, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeD-25447] 14:54:28,406 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, unionConsistentHash=null, newTopologyId=17} 14:54:28,406 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,406 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,406 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 17 14:54:28,406 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Initialized topology confirmation collector 18@___defaultcache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,406 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t1) Check if topology CacheTopology{id=17, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,406 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 17 14:54:28,406 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Rebalance confirmation collector 17@opt-cache received confirmation for test-NodeD-25447, remaining list is [] 14:54:28,406 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t6) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,407 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t4) Cache opt-cache topology updated: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,407 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,407 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending test-NodeA-55522#47 14:54:28,407 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache ___defaultcache: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,407 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=47], TP: [cluster_name=ISPN] 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,407 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 used 6030 credits, 1804670 remaining 14:54:28,407 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Initialized topology confirmation collector 18@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,407 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6030 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=47], TP: [cluster_name=ISPN] 14:54:28,407 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,407 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6030 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=47], TP: [cluster_name=ISPN] 14:54:28,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#47 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#47 14:54:28,407 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#47 14:54:28,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#47 14:54:28,407 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,407 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Updating local topology for cache opt-cache: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,407 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,407 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,407 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,407 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,407 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeA-55522 used 6030 credits, 1804670 remaining 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,407 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,407 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t2) Installing new cache topology CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,407 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,407 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,407 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,407 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t2) (isRunning=true) Installed new topology 18: CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,407 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling topology 18 is installed 14:54:28,407 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,407 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:28,407 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,407 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t3) Installing new cache topology CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,407 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,407 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling transaction data received for topology 18 14:54:28,407 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,407 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,407 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,407 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Topology changed, recalculating minTopologyId 14:54:28,407 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t2) Changing minimum topology ID from 17 to 18 14:54:28,407 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,408 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) Check if topology CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,408 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t2) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 18 14:54:28,408 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t2) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 18 14:54:28,407 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending test-NodeA-55522#48 14:54:28,407 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,407 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,407 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,408 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,408 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 6030 credits, 1853484 remaining 14:54:28,408 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t3) (isRunning=true) Installed new topology 18: CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Updating local topology for cache ___defaultcache: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 18: CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 18 is installed 14:54:28,408 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,408 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 18 14:54:28,408 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,408 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t4) Installing new cache topology CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,408 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=48], TP: [cluster_name=ISPN] 14:54:28,408 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t3) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeA-55522, topology id = 18 14:54:28,408 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling topology 18 is installed 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeA-p132-t3) [Context=___defaultcache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 18 14:54:28,408 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t3) Rebalance confirmation collector 18@___defaultcache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:28,408 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t4) (isRunning=true) Installed new topology 18: CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling topology 18 is installed 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,408 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 used 6024 credits, 1798646 remaining 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,408 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling transaction data received for topology 18 14:54:28,408 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=6024 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=48], TP: [cluster_name=ISPN] 14:54:28,408 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:28,408 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=6024 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=48], TP: [cluster_name=ISPN] 14:54:28,408 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeA-p132-t2) Rebalance confirmation collector 18@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:28,408 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#48 14:54:28,409 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#48 14:54:28,408 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,408 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#48 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:28,409 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#48 14:54:28,409 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #63, conn_id=0) 14:54:28,409 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,409 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=63, TP: [cluster_name=ISPN] 14:54:28,409 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling transaction data received for topology 18 14:54:28,409 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,409 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,409 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 6024 credits, 1847460 remaining 14:54:28,409 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,409 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,409 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,409 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=63, TP: [cluster_name=ISPN] 14:54:28,409 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t2) Updating local topology for cache opt-cache: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #39, conn_id=0) 14:54:28,409 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #63, conn_id=0) 14:54:28,409 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) Check if topology CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:28,409 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeA-55522 used 6024 credits, 1798646 remaining 14:54:28,409 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t4) Updating local topology for cache opt-cache: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#63 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,409 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:28,409 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,409 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) Check if topology CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeB-18592] 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 6-9 11 14 18 22 27 34-35 39 42-43 45-49 52 55-56 61 68 71 75 81-82 90-91 94-95 103 111-113 118-119 123 130 137-138 142-143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 227-228 230-232 235 237-239 244 252-255}, backup: {1 10 13 17 21 26 33 38 51 60 67 69-70 74 93 102 116-117 121-122 129 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 233-234 236 243 251} test-NodeB-18592 primary: {13 16-17 19-20 23 25 28-31 40-41 50-51 54 57 62 65-67 69-70 74 78 80 83-84 86-87 89 92-93 96 101-102 104 107 120 128 132-133 136 149 151 155 159-160 162-165 168 172 174-176 180-182 184-186 189-190 193-194 196-197 208 212 215 218-219 225-226 236 242 245-251}, backup: {12 22 24 27 53 56 61 63-64 68 72-73 77 79 88 94-95 103 105-106 118-119 126-127 134-135 148 150 154 158 161 167 171 179 207 211 214 224 235 240-241} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 32-33 36-38 44 53 58-60 63-64 72-73 76-77 79 85 88 97-100 105-106 108-110 114-117 121-122 124-127 129 131 134-135 139-141 144-147 154 156-157 166-167 171 178-179 183 187 198-199 203-206 210 213 217 220 222-224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 34-35 43 52 62 71 78 84 87 96 104 120 123 128 130 133 152-153 155 169-170 182 185-186 200-202 209 212 216 219 228 231-232 237-239 242 255} 14:54:28,409 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeB-18592, topology id = 18 14:54:28,409 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #39, conn_id=0) 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,409 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) [Context=___defaultcache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 18 14:54:28,409 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,409 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#39 14:54:28,409 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Rebalance confirmation collector 18@___defaultcache received confirmation for test-NodeB-18592, remaining list is [test-NodeD-25447] 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,409 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t2) Installing new cache topology CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,409 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeD-25447] 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,409 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeD-25447, topology id = 18 14:54:28,409 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,409 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t4) Installing new cache topology CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,409 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) [Context=___defaultcache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 18 14:54:28,409 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,409 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Rebalance confirmation collector 18@___defaultcache received confirmation for test-NodeD-25447, remaining list is [] 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,409 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t4) Cache ___defaultcache topology updated: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,409 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t2) (isRunning=true) Installed new topology 18: CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling topology 18 is installed 14:54:28,409 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,409 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling transaction data received for topology 18 14:54:28,409 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,409 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t4) (isRunning=true) Installed new topology 18: CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling topology 18 is installed 14:54:28,409 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,409 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,409 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending test-NodeA-55522#49 14:54:28,409 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,409 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=49], TP: [cluster_name=ISPN] 14:54:28,409 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating local topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,409 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 --> DATA(test-NodeA-55522: #40, conn_id=0) 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:28,409 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling transaction data received for topology 18 14:54:28,409 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 used 3342 credits, 1795304 remaining 14:54:28,409 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,409 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,409 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,409 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Topology changed, recalculating minTopologyId 14:54:28,409 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Changing minimum topology ID from 17 to 18 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=49], TP: [cluster_name=ISPN] 14:54:28,409 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t4) Updating stable topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=49], TP: [cluster_name=ISPN] 14:54:28,409 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#49 14:54:28,410 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Updating cluster-wide stable topology for cache ___defaultcache, topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 sending command to test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,410 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t2) Check if topology CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending test-NodeA-55522#50 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#49 14:54:28,409 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t4) Installing new cache topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#49 14:54:28,410 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #40, conn_id=0) 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=50], TP: [cluster_name=ISPN] 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #64, conn_id=0) 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#49 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=64, TP: [cluster_name=ISPN] 14:54:28,410 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#40 14:54:28,410 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t4) (isRunning=true) Installed new topology 19: CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling topology 19 is installed 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:28,410 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 used 3340 credits, 1791964 remaining 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache ___defaultcache we have: added segments: {}; removed segments: {159 168} 14:54:28,410 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,410 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Topology changed, recalculating minTopologyId 14:54:28,410 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Changing minimum topology ID from 17 to 18 14:54:28,410 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=64, TP: [cluster_name=ISPN] 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3340 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=50], TP: [cluster_name=ISPN] 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#50 14:54:28,410 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#50 14:54:28,410 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 19: CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 19 is installed 14:54:28,410 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,410 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,410 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3340 credits, 1844120 remaining 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: added segments: {}; removed segments: {134-135 158 174} 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,410 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t6) Updating stable topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3340 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=50], TP: [cluster_name=ISPN] 14:54:28,410 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+90, test-NodeB-18592: 85+84, test-NodeD-25447: 86+91]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, unionConsistentHash=null, newTopologyId=18} 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#50 14:54:28,410 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #64, conn_id=0) 14:54:28,410 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) Check if topology CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#64 14:54:28,410 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,410 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) On stable topology update. Pending txs: 0 14:54:28,410 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) Check if topology CacheTopology{id=18, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#50 14:54:28,410 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 19 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeD-25447] 14:54:28,410 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,410 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,410 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling transaction data received for topology 19 14:54:28,410 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 18 14:54:28,410 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Removing no longer owned entries for cache ___defaultcache 14:54:28,410 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=18, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=27} [sender=test-NodeB-18592] 14:54:28,410 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,410 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 18 14:54:28,410 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,410 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeA-55522 used 3340 credits, 1795306 remaining 14:54:28,410 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t6) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 18 14:54:28,410 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,410 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Removing no longer owned entries for cache ___defaultcache 14:54:28,410 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeA-p130-t4) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 18 14:54:28,410 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeA-55522 used 3342 credits, 1795304 remaining 14:54:28,410 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,410 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating stable topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,410 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,410 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t6) Rebalance confirmation collector 18@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeD-25447] 14:54:28,410 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,411 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating stable topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) On stable topology update. Pending txs: 0 14:54:28,411 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 3342 credits, 1840778 remaining 14:54:28,411 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t5) Installing new cache topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:28,411 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) On stable topology update. Pending txs: 0 14:54:28,411 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeA-p130-t4) Rebalance confirmation collector 18@opt-cache received confirmation for test-NodeD-25447, remaining list is [] 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t4) Cache opt-cache topology updated: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], joiners = [] 14:54:28,411 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t5) (isRunning=true) Installed new topology 19: CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling topology 19 is installed 14:54:28,411 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeA-p130-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,411 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache ___defaultcache we have: added segments: {}; removed segments: {58 108 222} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,411 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling transaction data received for topology 19 14:54:28,411 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,411 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,411 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending test-NodeA-55522#51 14:54:28,411 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Removing no longer owned entries for cache ___defaultcache 14:54:28,411 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=51], TP: [cluster_name=ISPN] 14:54:28,411 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) On stable topology update. Pending txs: 0 14:54:28,411 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,411 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 used 3336 credits, 1788628 remaining 14:54:28,411 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,411 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=51], TP: [cluster_name=ISPN] 14:54:28,411 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#51 14:54:28,411 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeA-p130-t4) Updating stable topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#51 14:54:28,411 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=51], TP: [cluster_name=ISPN] 14:54:28,411 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,411 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,411 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,411 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#51 14:54:28,411 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,411 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending test-NodeA-55522#52 14:54:28,411 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,411 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,411 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [MSG, seqno=52], TP: [cluster_name=ISPN] 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#51 14:54:28,411 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,411 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 19: CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 19 is installed 14:54:28,411 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,411 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 used 3334 credits, 1785294 remaining 14:54:28,411 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Updating local topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {}; removed segments: {159 168} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,411 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 19 14:54:28,411 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,411 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) Installing new cache topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,411 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,411 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t2) (isRunning=true) Installed new topology 19: CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling topology 19 is installed 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache opt-cache we have: added segments: {}; removed segments: {134-135 158 174} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,412 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling transaction data received for topology 19 14:54:28,412 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,412 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,412 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Removing no longer owned entries for cache opt-cache 14:54:28,412 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,412 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Topology changed, recalculating minTopologyId 14:54:28,412 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t2) Changing minimum topology ID from 18 to 19 14:54:28,412 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,412 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=52], TP: [cluster_name=ISPN] 14:54:28,412 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeA-55522#52 14:54:28,412 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#52 14:54:28,412 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,412 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,412 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:28,412 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeA-55522 used 3334 credits, 1788630 remaining 14:54:28,411 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeA-55522 used 3336 credits, 1788628 remaining 14:54:28,411 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,411 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=52], TP: [cluster_name=ISPN] 14:54:28,412 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,412 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t1) Updating stable topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeA-55522#52 14:54:28,412 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,412 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#52 14:54:28,412 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Removing no longer owned entries for cache opt-cache 14:54:28,412 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) On stable topology update. Pending txs: 0 14:54:28,412 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,412 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t3) Updating local topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,412 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,412 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeA-55522 used 3334 credits, 1837444 remaining 14:54:28,412 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,412 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:28,412 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Changing minimum topology ID from 18 to 19 14:54:28,412 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,412 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:28,412 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeA-55522 used 3336 credits, 1834108 remaining 14:54:28,412 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t3) Installing new cache topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:28,412 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,412 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,412 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,412 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating stable topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t3) (isRunning=true) Installed new topology 19: CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling topology 19 is installed 14:54:28,412 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) On stable topology update. Pending txs: 0 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache opt-cache we have: added segments: {}; removed segments: {58 108 222} 14:54:28,412 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:28,412 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling transaction data received for topology 19 14:54:28,412 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:28,412 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:28,413 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Removing no longer owned entries for cache opt-cache 14:54:28,413 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,413 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) Topology changed, recalculating minTopologyId 14:54:28,413 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t3) Changing minimum topology ID from 18 to 19 14:54:28,413 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=19} 14:54:28,413 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,413 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t3) Updating stable topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,413 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) Check if topology CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:28,413 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) On stable topology update. Pending txs: 0 14:54:28,443 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeA-55522: #15) 14:54:28,443 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=8, TP: [cluster_name=ISPN] 14:54:28,443 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeB-18592: #15) 14:54:28,443 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=9, TP: [cluster_name=ISPN] 14:54:28,443 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=8, TP: [cluster_name=ISPN] 14:54:28,443 TRACE [org.jgroups.protocols.DISCARD] (jgroups-6,test-NodeA-55522) null: dropping message from test-NodeC-10992 14:54:28,443 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=9, TP: [cluster_name=ISPN] 14:54:28,443 TRACE [org.jgroups.protocols.DISCARD] (jgroups-15,test-NodeB-18592) test-NodeB-18592: dropping message from test-NodeC-10992 14:54:28,457 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeB-18592: #64) 14:54:28,457 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=64, ts=12, TP: [cluster_name=ISPN] 14:54:28,457 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeD-25447: #40) 14:54:28,457 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=40, ts=13, TP: [cluster_name=ISPN] 14:54:28,457 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=64, ts=12, TP: [cluster_name=ISPN] 14:54:28,457 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=40, ts=13, TP: [cluster_name=ISPN] 14:54:28,457 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeA-55522: #64, conn-id=0, ts=12) 14:54:28,457 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeA-55522: #40, conn-id=0, ts=13) 14:54:28,480 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeA-55522: #34) 14:54:28,480 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=34, ts=14, TP: [cluster_name=ISPN] 14:54:28,480 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeD-25447: #15) 14:54:28,480 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=15, TP: [cluster_name=ISPN] 14:54:28,480 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> XMIT(test-NodeC-10992: #15) 14:54:28,480 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=34, ts=14, TP: [cluster_name=ISPN] 14:54:28,480 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeB-18592: #34, conn-id=0, ts=14) 14:54:28,481 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,481 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=15, TP: [cluster_name=ISPN] 14:54:28,481 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeB-18592: #15, conn-id=1, ts=15) 14:54:28,481 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,481 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeB-18592 14:54:28,489 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeA-55522: #26) 14:54:28,489 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=26, conn_id=2, ts=9, TP: [cluster_name=ISPN] 14:54:28,489 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeB-18592: #15) 14:54:28,489 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=15, conn_id=2, ts=10, TP: [cluster_name=ISPN] 14:54:28,489 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=26, conn_id=2, ts=9, TP: [cluster_name=ISPN] 14:54:28,489 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeD-25447: #26, conn-id=2, ts=9) 14:54:28,489 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=2, ts=10, TP: [cluster_name=ISPN] 14:54:28,489 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeD-25447: #15, conn-id=2, ts=10) 14:54:28,543 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeA-55522: #31) 14:54:28,544 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,544 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeB-18592: #15) 14:54:28,544 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,544 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=3417 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,544 TRACE [org.jgroups.protocols.DISCARD] (jgroups-6,test-NodeA-55522) test-NodeA-55522: dropping message from test-NodeC-10992 14:54:28,544 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,544 TRACE [org.jgroups.protocols.DISCARD] (jgroups-15,test-NodeB-18592) test-NodeB-18592: dropping message from test-NodeC-10992 14:54:28,557 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> XMIT(test-NodeC-10992: #19) 14:54:28,558 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,558 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,558 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,558 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeA-55522 14:54:28,558 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,558 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,581 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> XMIT(test-NodeC-10992: #15) 14:54:28,581 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,581 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,581 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeB-18592 14:54:28,644 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeA-55522: #31) 14:54:28,644 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,644 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeB-18592: #15) 14:54:28,644 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,644 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=3417 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,644 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,644 TRACE [org.jgroups.protocols.DISCARD] (jgroups-6,test-NodeA-55522) test-NodeA-55522: dropping message from test-NodeC-10992 14:54:28,644 TRACE [org.jgroups.protocols.DISCARD] (jgroups-15,test-NodeB-18592) test-NodeB-18592: dropping message from test-NodeC-10992 14:54:28,658 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> XMIT(test-NodeC-10992: #19) 14:54:28,658 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,658 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,658 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,658 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeA-55522 14:54:28,658 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,658 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,681 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> XMIT(test-NodeC-10992: #15) 14:54:28,681 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,682 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,682 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeB-18592 14:54:28,744 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeA-55522: #31) 14:54:28,745 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,745 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeB-18592: #15) 14:54:28,745 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,745 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=3417 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,745 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,745 TRACE [org.jgroups.protocols.DISCARD] (jgroups-6,test-NodeA-55522) test-NodeA-55522: dropping message from test-NodeC-10992 14:54:28,745 TRACE [org.jgroups.protocols.DISCARD] (jgroups-15,test-NodeB-18592) test-NodeB-18592: dropping message from test-NodeC-10992 14:54:28,758 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> XMIT(test-NodeC-10992: #19) 14:54:28,758 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,758 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,758 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,758 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeA-55522 14:54:28,758 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,758 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,781 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,781 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,781 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,781 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,781 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,782 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> XMIT(test-NodeC-10992: #15) 14:54:28,782 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,782 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,782 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeB-18592 14:54:28,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,845 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeA-55522: #31) 14:54:28,845 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,845 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeB-18592: #15) 14:54:28,845 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,845 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=3417 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,845 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,845 TRACE [org.jgroups.protocols.DISCARD] (jgroups-6,test-NodeA-55522) test-NodeA-55522: dropping message from test-NodeC-10992 14:54:28,845 TRACE [org.jgroups.protocols.DISCARD] (jgroups-15,test-NodeB-18592) test-NodeB-18592: dropping message from test-NodeC-10992 14:54:28,858 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> XMIT(test-NodeC-10992: #19) 14:54:28,858 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,859 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,859 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,859 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeA-55522 14:54:28,859 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,859 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,882 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> XMIT(test-NodeC-10992: #15) 14:54:28,882 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,882 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,882 TRACE [org.jgroups.protocols.DISCARD] (jgroups-7,test-NodeC-10992) test-NodeC-10992: dropping message from test-NodeB-18592 14:54:28,893 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,893 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,893 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,894 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,894 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:28,903 DEBUG [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Merging cluster 14:54:28,904 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeC-10992: installing view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,904 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-17,test-NodeC-10992) test-NodeC-10992: pinger_thread started 14:54:28,904 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeA-55522, sending response test-NodeA-55522, name=test-NodeA-55522, addr=127.0.0.1:7900, server 14:54:28,904 DEBUG [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-17,test-NodeC-10992) test-NodeC-10992: ping_dest is test-NodeA-55522, pingable_mbrs=[test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,904 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,904 TRACE [org.jgroups.protocols.TCP_NIO2] (FD_SOCK pinger-17,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are FD_SOCK: WHO_HAS_SOCK, mbr=test-NodeA-55522, TP: [cluster_name=ISPN] 14:54:28,904 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeB-18592, sending response test-NodeA-55522, name=test-NodeA-55522, addr=127.0.0.1:7900, server 14:54:28,904 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,904 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,904 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeD-25447, sending response test-NodeA-55522, name=test-NodeA-55522, addr=127.0.0.1:7900, server 14:54:28,904 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_SOCK: WHO_HAS_SOCK, mbr=test-NodeA-55522, TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received GET_MBRS_RSP from test-NodeC-10992: test-NodeA-55522, name=test-NodeA-55522, addr=127.0.0.1:7900, server 14:54:28,904 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.jgroups.protocols.FD_SOCK] (jgroups-15,test-NodeA-55522) test-NodeA-55522: who-has-sock test-NodeA-55522 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received GET_MBRS_RSP from test-NodeC-10992: test-NodeA-55522, name=test-NodeA-55522, addr=127.0.0.1:7900, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are FD_SOCK: I_HAVE_SOCK, mbr=test-NodeA-55522, sock_addr=127.0.0.1:40955, TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) 127.0.0.1:7902: connecting to 127.0.0.1:7903 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_SOCK: I_HAVE_SOCK, mbr=test-NodeA-55522, sock_addr=127.0.0.1:40955, TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeA-55522, sending response test-NodeB-18592, name=test-NodeB-18592, addr=127.0.0.1:7901, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeB-18592, sending response test-NodeB-18592, name=test-NodeB-18592, addr=127.0.0.1:7901, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.jgroups.protocols.FD_SOCK] (jgroups-7,test-NodeC-10992) test-NodeC-10992: i-have-sock: test-NodeA-55522 --> 127.0.0.1:40955 (cache is test-NodeA-55522: 127.0.0.1:40955 (0 ms old) test-NodeC-10992: 127.0.0.1:43841 (1 secs old) ) 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeD-25447, sending response test-NodeB-18592, name=test-NodeB-18592, addr=127.0.0.1:7901, server 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received GET_MBRS_RSP from test-NodeC-10992: test-NodeB-18592, name=test-NodeB-18592, addr=127.0.0.1:7901, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeA-55522, sending response test-NodeD-25447, name=test-NodeD-25447, addr=127.0.0.1:7903, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received GET_MBRS_RSP from test-NodeC-10992: test-NodeB-18592, name=test-NodeB-18592, addr=127.0.0.1:7901, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeB-18592, sending response test-NodeD-25447, name=test-NodeD-25447, addr=127.0.0.1:7903, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received GET_MBRS_RSP from test-NodeC-10992: test-NodeA-55522, name=test-NodeA-55522, addr=127.0.0.1:7900, server 14:54:28,905 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,905 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK acceptor-4,test-NodeA-55522) test-NodeA-55522: accepted connection from /127.0.0.1:54401 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (TestNG) test-NodeC-10992: received GET_MBRS_REQ from test-NodeD-25447, sending response test-NodeD-25447, name=test-NodeD-25447, addr=127.0.0.1:7903, server 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received GET_MBRS_RSP from test-NodeC-10992: test-NodeD-25447, name=test-NodeD-25447, addr=127.0.0.1:7903, server 14:54:28,906 TRACE [org.jgroups.protocols.TCP_NIO2] (TestNG) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,906 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-17,test-NodeC-10992) test-NodeC-10992: ping_dest=test-NodeA-55522, ping_sock=Socket[addr=/127.0.0.1,port=40955,localport=54401], cache=test-NodeA-55522: 127.0.0.1:40955 (0 ms old) test-NodeC-10992: 127.0.0.1:43841 (1 secs old) 14:54:28,905 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received GET_MBRS_RSP from test-NodeC-10992: test-NodeB-18592, name=test-NodeB-18592, addr=127.0.0.1:7901, server 14:54:28,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,906 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received GET_MBRS_RSP from test-NodeC-10992: test-NodeD-25447, name=test-NodeD-25447, addr=127.0.0.1:7903, server 14:54:28,906 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=48 bytes, flags=OOB|DONT_BUNDLE|INTERNAL], headers are 1320: [GET_MBRS_RSP cluster=null initial_discovery=false], TP: [cluster_name=ISPN] 14:54:28,906 TRACE [org.infinispan.test.fwk.TEST_PING] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received GET_MBRS_RSP from test-NodeC-10992: test-NodeD-25447, name=test-NodeD-25447, addr=127.0.0.1:7903, server 14:54:28,906 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,906 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000093: Received new, MERGED cluster view for channel ISPN: MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,906 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], Left: [] 14:54:28,906 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,906 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@2e62fffb passing event EventImpl{type=MERGED, newMembers=[test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeC-10992], localAddress=test-NodeC-10992, viewId=30, subgroupsMerged=[[test-NodeC-10992], [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447]], mergeView=true} 14:54:28,906 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100000: Node test-NodeA-55522 joined the cluster 14:54:28,906 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Received new cluster view: 30, isCoordinator = true, old status = COORDINATOR 14:54:28,906 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100000: Node test-NodeB-18592 joined the cluster 14:54:28,906 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Recovering cluster status for view 30 14:54:28,906 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100000: Node test-NodeD-25447 joined the cluster 14:54:28,906 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,906 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 sending request 20 to all: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=test-NodeC-10992, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:28,907 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992: sending test-NodeC-10992#1 14:54:28,907 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 14:54:28,907 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeA-55522: installing view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,907 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 used 11 credits, 1999989 remaining 14:54:28,907 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=test-NodeC-10992, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:28,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (3 headers), size=11 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 14:54:28,907 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#1 14:54:28,907 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Sending cluster status response for view 30 14:54:28,907 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#1 14:54:28,907 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received request 20 from test-NodeC-10992: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:28,907 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:28,907 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:28,907 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) Waiting for transaction data for view 30, current view is 27 14:54:28,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (3 headers), size=11 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 14:54:28,907 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,907 WARN [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) JGRP000011: test-NodeB-18592: dropped message 1 from non-member test-NodeC-10992 (view=[test-NodeA-55522|27] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447]) 14:54:28,907 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,907 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000093: Received new, MERGED cluster view for channel ISPN: MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,907 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [test-NodeC-10992], Left: [] 14:54:28,907 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,907 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@a9f2daf passing event EventImpl{type=MERGED, newMembers=[test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], localAddress=test-NodeA-55522, viewId=30, subgroupsMerged=[[test-NodeC-10992], [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447]], mergeView=true} 14:54:28,907 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeA-p130-t4) Sending cluster status response for view 30 14:54:28,907 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Received new cluster view: 30, isCoordinator = false, old status = COORDINATOR 14:54:28,907 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100000: Node test-NodeC-10992 joined the cluster 14:54:28,907 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,907 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 20 to test-NodeC-10992: SuccessfulResponse(ManagerStatusResponse{caches={opt-cache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=392a5da1-6e12-417a-b1a8-c0042ca205f4, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}, ___defaultcache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=392a5da1-6e12-417a-b1a8-c0042ca205f4, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}}, rebalancingEnabled=true}) 14:54:28,907 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeB-18592: installing view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,908 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #20, conn_id=1) 14:54:28,908 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,908 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,908 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=6794 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,908 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #20, conn_id=1) 14:54:28,908 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#20 14:54:28,908 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000093: Received new, MERGED cluster view for channel ISPN: MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,908 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [test-NodeC-10992], Left: [] 14:54:28,908 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,908 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@47525ccd passing event EventImpl{type=MERGED, newMembers=[test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], localAddress=test-NodeB-18592, viewId=30, subgroupsMerged=[[test-NodeC-10992], [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447]], mergeView=true} 14:54:28,908 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeB-p140-t3) Received new cluster view: 30, isCoordinator = false, old status = REGULAR_MEMBER 14:54:28,908 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100000: Node test-NodeC-10992 joined the cluster 14:54:28,908 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,908 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received response for request 20 from test-NodeA-55522: SuccessfulResponse(ManagerStatusResponse{caches={opt-cache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=392a5da1-6e12-417a-b1a8-c0042ca205f4, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}, ___defaultcache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=392a5da1-6e12-417a-b1a8-c0042ca205f4, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}}, rebalancingEnabled=true}) 14:54:28,908 DEBUG [org.jgroups.protocols.pbcast.GMS] (TestNG) test-NodeD-25447: installing view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,909 DEBUG [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-9,test-NodeD-25447) test-NodeD-25447: socket to test-NodeA-55522 was closed gracefully 14:54:28,909 DEBUG [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-9,test-NodeD-25447) test-NodeD-25447: ping_dest is test-NodeC-10992, pingable_mbrs=[test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,909 TRACE [org.jgroups.protocols.TCP_NIO2] (FD_SOCK pinger-9,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are FD_SOCK: WHO_HAS_SOCK, mbr=test-NodeC-10992, TP: [cluster_name=ISPN] 14:54:28,909 TRACE [org.jgroups.protocols.tom.TOA] (TestNG) Handle view MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,909 TRACE [org.jgroups.protocols.MFC] (TestNG) new membership: [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,909 INFO [org.infinispan.CLUSTER] (TestNG) ISPN000093: Received new, MERGED cluster view for channel ISPN: MergeView::[test-NodeC-10992|30] (4) [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], 2 subgroups: [test-NodeC-10992|28] (1) [test-NodeC-10992], [test-NodeA-55522|29] (3) [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:28,909 DEBUG [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (TestNG) Joined: [test-NodeC-10992], Left: [] 14:54:28,909 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,909 TRACE [org.infinispan.notifications.cachemanagerlistener.CacheManagerNotifierImpl] (TestNG) Invoking listener: org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener@46db06db passing event EventImpl{type=MERGED, newMembers=[test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], oldMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], localAddress=test-NodeD-25447, viewId=30, subgroupsMerged=[[test-NodeC-10992], [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447]], mergeView=true} 14:54:28,909 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeD-p156-t1) Received new cluster view: 30, isCoordinator = false, old status = REGULAR_MEMBER 14:54:28,909 INFO [org.infinispan.CLUSTER] (TestNG) ISPN100000: Node test-NodeC-10992 joined the cluster 14:54:28,909 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (TestNG) Added a new task directly: 0 task(s) are waiting 14:54:28,909 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_SOCK: WHO_HAS_SOCK, mbr=test-NodeC-10992, TP: [cluster_name=ISPN] 14:54:28,909 TRACE [org.jgroups.protocols.FD_SOCK] (jgroups-7,test-NodeC-10992) test-NodeC-10992: who-has-sock test-NodeC-10992 14:54:28,909 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are FD_SOCK: I_HAVE_SOCK, mbr=test-NodeC-10992, sock_addr=127.0.0.1:43841, TP: [cluster_name=ISPN] 14:54:28,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_SOCK: I_HAVE_SOCK, mbr=test-NodeC-10992, sock_addr=127.0.0.1:43841, TP: [cluster_name=ISPN] 14:54:28,910 TRACE [org.jgroups.protocols.FD_SOCK] (jgroups-6,test-NodeD-25447) test-NodeD-25447: i-have-sock: test-NodeC-10992 --> 127.0.0.1:43841 (cache is test-NodeA-55522: 127.0.0.1:40955 (1 secs old) test-NodeB-18592: 127.0.0.1:46123 (1 secs old) test-NodeD-25447: 127.0.0.1:46159 (1 secs old) test-NodeC-10992: 127.0.0.1:43841 (0 ms old) ) 14:54:28,910 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK acceptor-4,test-NodeC-10992) test-NodeC-10992: accepted connection from /127.0.0.1:56137 14:54:28,910 TRACE [org.jgroups.protocols.FD_SOCK] (FD_SOCK pinger-9,test-NodeD-25447) test-NodeD-25447: ping_dest=test-NodeC-10992, ping_sock=Socket[addr=/127.0.0.1,port=43841,localport=56137], cache=test-NodeA-55522: 127.0.0.1:40955 (1 secs old) test-NodeB-18592: 127.0.0.1:46123 (1 secs old) test-NodeD-25447: 127.0.0.1:46159 (1 secs old) test-NodeC-10992: 127.0.0.1:43841 (0 ms old) 14:54:28,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (3 headers), size=11 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, NAKACK2: [MSG, seqno=1], TP: [cluster_name=ISPN] 14:54:28,910 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#1 14:54:28,910 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#1 14:54:28,910 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 20 from test-NodeC-10992: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:28,910 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:28,910 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:28,910 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeC-10992 used 11 credits, 1999989 remaining 14:54:28,910 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeD-p154-t5) Sending cluster status response for view 30 14:54:28,911 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 20 to test-NodeC-10992: SuccessfulResponse(ManagerStatusResponse{caches={opt-cache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=2d4a49f6-ead4-4503-aaf3-1f0a60265602, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}, ___defaultcache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=2d4a49f6-ead4-4503-aaf3-1f0a60265602, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}}, rebalancingEnabled=true}) 14:54:28,911 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeC-10992: #6, conn_id=2) 14:54:28,911 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=13020 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 14:54:28,911 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #6, conn_id=2) 14:54:28,911 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#6 14:54:28,911 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received response for request 20 from test-NodeD-25447: SuccessfulResponse(ManagerStatusResponse{caches={opt-cache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=2d4a49f6-ead4-4503-aaf3-1f0a60265602, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}, ___defaultcache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=2d4a49f6-ead4-4503-aaf3-1f0a60265602, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}}, rebalancingEnabled=true}) 14:54:28,945 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeA-55522: #15) 14:54:28,945 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=10, TP: [cluster_name=ISPN] 14:54:28,945 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeD-25447: #6) 14:54:28,945 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=6, conn_id=2, ts=11, TP: [cluster_name=ISPN] 14:54:28,945 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=10, TP: [cluster_name=ISPN] 14:54:28,945 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeC-10992: #15, conn-id=1, ts=10) 14:54:28,945 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeA-55522: #31) 14:54:28,945 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,946 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> XMIT(test-NodeB-18592: #15) 14:54:28,946 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=6, conn_id=2, ts=11, TP: [cluster_name=ISPN] 14:54:28,946 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,946 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeC-10992: #6, conn-id=2, ts=11) 14:54:28,946 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=3417 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=14, rsp_expected=true, UNICAST3: DATA, seqno=31, TP: [cluster_name=ISPN] 14:54:28,946 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #31, conn_id=0) 14:54:28,946 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#31 14:54:28,946 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,946 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #15, conn_id=1) 14:54:28,946 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 14 from test-NodeC-10992: ExceptionResponse(java.lang.IllegalStateException: Cannot create remote transaction GlobalTx:test-NodeA-55522:15, the originator is not in the cluster view) 14:54:28,946 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-15,test-NodeA-55522) Ignoring response for non-existent request 14 from test-NodeC-10992: ExceptionResponse(java.lang.IllegalStateException: Cannot create remote transaction GlobalTx:test-NodeA-55522:15, the originator is not in the cluster view) 14:54:28,959 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeC-10992: #31) 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=31, ts=14, TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=31, ts=14, TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeA-55522: #31, conn-id=0, ts=14) 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: my_highest_rcvd (test-NodeA-55522#0) < highest received (test-NodeA-55522#52): requesting retransmission 14:54:28,959 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: sending XMIT_REQ ((1): {52}) to test-NodeA-55522 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are NAKACK2: [XMIT_REQ, sender=test-NodeA-55522], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=21 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [XMIT_REQ, sender=test-NodeA-55522], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received xmit request from test-NodeC-10992 for test-NodeA-55522(1): {52} 14:54:28,959 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::52 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=52], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=52], TP: [cluster_name=ISPN] 14:54:28,959 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#52 14:54:28,959 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#52 14:54:28,959 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:28,959 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:28,959 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:28,959 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeC-10992) test-NodeA-55522 used 3334 credits, 1996666 remaining 14:54:28,959 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring topology 19 for cache opt-cache from old coordinator test-NodeA-55522 14:54:28,982 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeC-10992: #15) 14:54:28,982 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=16, TP: [cluster_name=ISPN] 14:54:28,982 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> XMIT(test-NodeC-10992: #15) 14:54:28,982 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,982 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=16, TP: [cluster_name=ISPN] 14:54:28,982 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeB-18592: #15, conn-id=1, ts=16) 14:54:28,982 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=19, rsp_expected=true, UNICAST3: DATA, seqno=15, conn_id=1, TP: [cluster_name=ISPN] 14:54:28,982 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #15, conn_id=1) 14:54:29,046 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending XMIT_REQ ((4): {16-19}) to test-NodeA-55522 14:54:29,046 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: XMIT_REQ, seqno=0, TP: [cluster_name=ISPN] 14:54:29,046 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeB-18592: #15) 14:54:29,046 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=12, TP: [cluster_name=ISPN] 14:54:29,046 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=21 bytes, flags=OOB|INTERNAL], headers are UNICAST3: XMIT_REQ, seqno=0, TP: [cluster_name=ISPN] 14:54:29,046 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=15, conn_id=1, ts=12, TP: [cluster_name=ISPN] 14:54:29,046 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=1], TP: [cluster_name=ISPN] 14:54:29,046 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeC-10992: #15, conn-id=1, ts=12) 14:54:29,047 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- XMIT(test-NodeC-10992: #(4): {16-19}) 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=1], TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=1], TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=1], TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: my_highest_rcvd (test-NodeC-10992#0) < highest received (test-NodeC-10992#1): requesting retransmission 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: sending XMIT_REQ ((1): {1}) to test-NodeC-10992 14:54:29,047 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #16, conn_id=1) 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are NAKACK2: [XMIT_REQ, sender=test-NodeC-10992], TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#16 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=835 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #17, conn_id=1) 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#17 14:54:29,047 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=392 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,047 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #18, conn_id=1) 14:54:29,047 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#18 14:54:29,048 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=21 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [XMIT_REQ, sender=test-NodeC-10992], TP: [cluster_name=ISPN] 14:54:29,048 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,048 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received request 28 from test-NodeA-55522: VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,048 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 16 from test-NodeA-55522: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,048 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #19, conn_id=1) 14:54:29,048 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received xmit request from test-NodeB-18592 for test-NodeC-10992(1): {1} 14:54:29,048 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute CacheRpcCommand: VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} [sender=test-NodeA-55522] 14:54:29,048 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#19 14:54:29,048 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: resending test-NodeC-10992::1 14:54:29,048 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} [sender=test-NodeA-55522] 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-10,test-NodeC-10992) [Blocking] Checking command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}}. 14:54:29,048 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:29,048 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received request 23 from test-NodeA-55522: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,048 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=1], TP: [cluster_name=ISPN] 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-10,test-NodeC-10992) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeC-10992) [Blocking] Checking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:29,048 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} [sender=test-NodeA-55522] 14:54:29,048 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute CacheRpcCommand: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} [sender=test-NodeA-55522] 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-21,test-NodeC-10992) [Blocking] Checking command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} . 14:54:29,048 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=11 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=20, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=1], TP: [cluster_name=ISPN] 14:54:29,048 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task to the queue: 1 task(s) are waiting 14:54:29,048 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#1 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeC-10992) [Blocking] Checking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}. 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeC-10992) [Blocking] Blocking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,048 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#1 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-21,test-NodeC-10992) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeC) Tasks to be executed=0, still pending=~1 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeC-10992) [Blocking] Blocking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 20 from test-NodeC-10992: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task to the queue: 2 task(s) are waiting 14:54:29,048 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeC) Tasks to be executed=0, still pending=~2 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeC-10992) [Blocking] Unblocking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,048 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeC-10992) [Blocking] Unblocking command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,048 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,048 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeC-10992) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeC-10992 used 11 credits, 1999989 remaining 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeC-10992) Checking if transaction data was received for topology 14, current topology is 15 14:54:29,048 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task to the queue: 3 task(s) are waiting 14:54:29,048 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (remote-thread-test-NodeB-p138-t4) Sending cluster status response for view 30 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,048 TRACE [org.infinispan.transaction.impl.TransactionTable] (jgroups-7,test-NodeC-10992) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:29,048 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeC) Tasks to be executed=0, still pending=~3 14:54:29,048 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-7,test-NodeC-10992) Checking for pending locks and then locking key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:29,048 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-7,test-NodeC-10992) No transactions pending for Transaction GlobalTx:test-NodeA-55522:15 14:54:29,048 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (jgroups-7,test-NodeC-10992) Stored PendingLock is NO_OP 14:54:29,048 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 20 to test-NodeC-10992: SuccessfulResponse(ManagerStatusResponse{caches={opt-cache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a513842f-3b63-47f4-8e08-30d8a40bd0c5, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}, ___defaultcache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a513842f-3b63-47f4-8e08-30d8a40bd0c5, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}}, rebalancingEnabled=true}) 14:54:29,048 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (jgroups-7,test-NodeC-10992) Registering locked key: MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (jgroups-7,test-NodeC-10992) Lock key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} for owner=GlobalTx:test-NodeA-55522:15. timeout=10000 (MILLISECONDS) 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Created a new one: LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15} 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Try acquire. Next in queue=LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15}. Current=null 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) Lock Owner CAS(null, LockPlaceHolder{lockState=WAITING, owner=GlobalTx:test-NodeA-55522:15}) => true 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) State changed for LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15}. WAITING => ACQUIRED 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (jgroups-7,test-NodeC-10992) LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} successfully acquired the lock. 14:54:29,049 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeC-10992: #16, conn_id=1) 14:54:29,049 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 3 task(s) are waiting 14:54:29,049 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,049 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,049 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeC-p146-t5) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab 14:54:29,049 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=13020 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,049 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #16, conn_id=1) 14:54:29,049 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#16 14:54:29,049 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t5) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:29,049 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t5) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}, origin test-NodeA-55522 14:54:29,049 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeC-p146-t5) Acquiring locks on MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. 14:54:29,049 TRACE [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] (remote-thread-test-NodeC-p146-t5) Acquiring backup locks on MagicKey#k1{8/537A1109/107@test-NodeB-18592}. 14:54:29,049 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received response for request 20 from test-NodeB-18592: SuccessfulResponse(ManagerStatusResponse{caches={opt-cache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a513842f-3b63-47f4-8e08-30d8a40bd0c5, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}, ___defaultcache=StatusResponse{cacheJoinInfo=CacheJoinInfo{consistentHashFactory=org.infinispan.distribution.ch.impl.SyncConsistentHashFactory@ffffd8e9, hashFunction=MurmurHash3, numSegments=256, numOwners=2, timeout=240000, totalOrder=false, cacheMode=DIST_SYNC, partitionHandling=true, persistentUUID=a513842f-3b63-47f4-8e08-30d8a40bd0c5, persistentStateChecksum=Optional.empty}, cacheTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stableTopology=CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}}}, rebalancingEnabled=true}) 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultPendingLockManager] (remote-thread-test-NodeC-p146-t5) Await for pending transactions for transaction GlobalTx:test-NodeA-55522:15 using NO_OP 14:54:29,049 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeC-p146-t5) Registering locked key: MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeC-p146-t5) Lock key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} for owner=GlobalTx:test-NodeA-55522:15. timeout=10000 (MILLISECONDS) 14:54:29,049 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t5) Acquire lock for GlobalTx:test-NodeA-55522:15. Timeout=10000 (MILLISECONDS) 14:54:29,050 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t5) Lock owner already exists: LockPlaceHolder{lockState=ACQUIRED, owner=GlobalTx:test-NodeA-55522:15} 14:54:29,050 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Got 4 status responses. members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Exists in context? null 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:29,050 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-thread-test-NodeC-p146-t5) Adding key MagicKey#k1{8/537A1109/107@test-NodeB-18592} to tx GlobalTx:test-NodeA-55522:15 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Cache opt-cache initialized. Persisted state? false 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Updated context entry null -> VersionedRepeatableReadEntry(7a4c1b3f){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Cache ___defaultcache initialized. Persisted state? false 14:54:29,050 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t5) Invoking: PutKeyValueCommand 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Exists in context? null 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:29,050 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Recovered 2 partition(s) for cache opt-cache: [CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}] 14:54:29,050 TRACE [org.infinispan.transaction.impl.RemoteTransaction] (remote-thread-test-NodeC-p146-t5) Adding key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} to tx GlobalTx:test-NodeA-55522:15 14:54:29,050 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Recovered 2 partition(s) for cache ___defaultcache: [CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}] 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Added joiner test-NodeA-55522 to cache opt-cache with persistent uuid 392a5da1-6e12-417a-b1a8-c0042ca205f4: members = [test-NodeA-55522], joiners = [test-NodeA-55522] 14:54:29,050 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t5) Updated context entry null -> VersionedRepeatableReadEntry(51ecb641){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Added joiner test-NodeA-55522 to cache ___defaultcache with persistent uuid 392a5da1-6e12-417a-b1a8-c0042ca205f4: members = [test-NodeA-55522], joiners = [test-NodeA-55522] 14:54:29,050 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t5) Invoking: PutKeyValueCommand 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Added joiner test-NodeB-18592 to cache ___defaultcache with persistent uuid a513842f-3b63-47f4-8e08-30d8a40bd0c5: members = [test-NodeA-55522, test-NodeB-18592], joiners = [test-NodeA-55522, test-NodeB-18592] 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Added joiner test-NodeB-18592 to cache opt-cache with persistent uuid a513842f-3b63-47f4-8e08-30d8a40bd0c5: members = [test-NodeA-55522, test-NodeB-18592], joiners = [test-NodeA-55522, test-NodeB-18592] 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Added joiner test-NodeC-10992 to cache ___defaultcache with persistent uuid a4bb04c4-2aa5-469c-b481-a543584bde06: members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], joiners = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:29,050 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t5) Invoking: VersionedPrepareCommand 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Added joiner test-NodeD-25447 to cache ___defaultcache with persistent uuid 2d4a49f6-ead4-4503-aaf3-1f0a60265602: members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Added joiner test-NodeC-10992 to cache opt-cache with persistent uuid a4bb04c4-2aa5-469c-b481-a543584bde06: members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], joiners = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:29,050 TRACE [org.infinispan.container.entries.VersionedRepeatableReadEntry] (remote-thread-test-NodeC-p146-t5) Comparing versions SimpleClusteredVersion{topologyId=13, version=1} and SimpleClusteredVersion{topologyId=13, version=1} for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}: EQUAL 14:54:29,050 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Added joiner test-NodeD-25447 to cache opt-cache with persistent uuid 2d4a49f6-ead4-4503-aaf3-1f0a60265602: members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,050 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t1) Max stable partition topology: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,050 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeC-p146-t5) Verifying transaction: alreadyCompleted=false 14:54:29,050 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t1) Max active partition topology: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,050 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t4) Max stable partition topology: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,050 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t4) Max active partition topology: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,050 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t1) Max degraded partition topology: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, all degraded: [CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}] 14:54:29,050 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t1) One of the partitions is available, using that partition's topology 14:54:29,050 TRACE [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t4) Max degraded partition topology: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}, all degraded: [CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeC-10992], persistentUUIDs=[a4bb04c4-2aa5-469c-b481-a543584bde06]}] 14:54:29,050 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t4) One of the partitions is available, using that partition's topology 14:54:29,050 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Updating topologies after merge for cache ___defaultcache, current topology = CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stable topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE, resolveConflicts = false 14:54:29,050 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Updating topologies after merge for cache opt-cache, current topology = CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, stable topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE, resolveConflicts = false 14:54:29,050 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,050 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeC-p146-t5) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=14}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(51ecb641){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(7a4c1b3f){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], lookedUpEntriesTopology=14, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:29,050 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,050 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,050 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 16 to test-NodeA-55522: UnsureResponse 14:54:29,050 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeA-55522: #32, conn_id=0) 14:54:29,050 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,050 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,050 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,050 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:29,050 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending test-NodeC-10992#2 14:54:29,050 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,050 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 14:54:29,050 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating local topology for cache opt-cache: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending test-NodeC-10992#3 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=2 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=16, rsp_expected=true, UNICAST3: DATA, seqno=32, TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,051 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,051 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 used 3342 credits, 1996647 remaining 14:54:29,051 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t5) Installing new cache topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#2 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=2], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#2 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#2 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#2 14:54:29,051 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,051 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,051 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,051 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,051 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,051 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = false, topology = CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #32, conn_id=0) 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=3], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#3 14:54:29,051 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t5) (isRunning=true) Installed new topology 20: CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 used 3336 credits, 1993311 remaining 14:54:29,051 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,051 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,051 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeA-55522) test-NodeC-10992 used 3342 credits, 1996658 remaining 14:54:29,051 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#2 14:54:29,051 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,051 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Updating local topology for cache ___defaultcache: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,051 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating cluster-wide stable topology for cache ___defaultcache, topology = CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending test-NodeC-10992#4 14:54:29,051 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = false, topology = CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,051 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 14:54:29,051 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,051 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending test-NodeC-10992#5 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 14:54:29,052 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 used 3334 credits, 1989977 remaining 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 14:54:29,052 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t4) After merge, cache opt-cache has recovered and is entering available mode 14:54:29,052 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 used 3340 credits, 1986637 remaining 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3340 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 14:54:29,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#5 14:54:29,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#5 14:54:29,052 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t1) After merge, cache ___defaultcache has recovered and is entering available mode 14:54:29,052 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,052 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,052 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,052 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeC-10992 used 3340 credits, 1996649 remaining 14:54:29,052 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Cache opt-cache topology updated: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,052 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Cache ___defaultcache topology updated: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,052 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,052 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,052 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,052 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,052 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,052 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending test-NodeC-10992#6 14:54:29,051 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,052 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t6) Installing new cache topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,052 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeC-10992 used 3342 credits, 1996647 remaining 14:54:29,051 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling topology 20 is installed 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#3 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#3 14:54:29,051 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#3 14:54:29,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#3 14:54:29,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#3 14:54:29,052 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#32 14:54:29,052 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,052 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: new segments: []; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,052 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 16 from test-NodeC-10992: UnsureResponse 14:54:29,052 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,052 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,052 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-15,test-NodeA-55522) Ignoring response for non-existent request 16 from test-NodeC-10992: UnsureResponse 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 14:54:29,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#2 14:54:29,052 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,052 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3340 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,053 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#6 14:54:29,053 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeC-10992 used 3342 credits, 1993307 remaining 14:54:29,053 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#6 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#6 14:54:29,052 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#4 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3340 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=5], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#4 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#4 14:54:29,052 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=4], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#4 14:54:29,051 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 20: CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#4 14:54:29,051 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,053 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,053 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,053 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=6], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#6 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#4 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#6 14:54:29,053 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,053 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#6 14:54:29,053 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,053 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeC-10992 used 3334 credits, 1989973 remaining 14:54:29,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,053 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,053 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeA-55522) test-NodeC-10992 used 3336 credits, 1993322 remaining 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#5 14:54:29,053 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 used 3336 credits, 1983301 remaining 14:54:29,053 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating local topology for cache opt-cache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,053 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Queueing rebalance for cache opt-cache with members [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending test-NodeC-10992#7 14:54:29,052 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,053 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeC) Tasks to be executed=0, still pending=~3 14:54:29,052 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,053 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,052 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,053 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeC-10992 used 3336 credits, 1986637 remaining 14:54:29,053 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 used 3342 credits, 1979959 remaining 14:54:29,053 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 14:54:29,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,054 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,054 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,054 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeC-10992 used 3336 credits, 1993311 remaining 14:54:29,053 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t4) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,053 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: added segments: {}; removed segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,053 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t6) (isRunning=true) Installed new topology 20: CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,053 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Rebalancing consistent hash for cache opt-cache, members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,054 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,054 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#5 14:54:29,053 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#5 14:54:29,054 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,054 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#5 14:54:29,053 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,054 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,054 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeD-25447) test-NodeC-10992 used 3334 credits, 1989977 remaining 14:54:29,054 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,054 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,054 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t4) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,054 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,054 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling topology 21 is installed 14:54:29,054 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache opt-cache: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,054 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,054 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,054 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,054 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling transaction data received for topology 21 14:54:29,054 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,054 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,054 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Removing no longer owned entries for cache opt-cache 14:54:29,054 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Updating cache opt-cache topology for rebalance: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,054 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Cache opt-cache topology updated: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,054 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,054 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Topology changed, recalculating minTopologyId 14:54:29,055 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Changing minimum topology ID from 19 to 21 14:54:29,055 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,055 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,055 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) On stable topology update. Pending txs: 0 14:54:29,053 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 20 is installed 14:54:29,055 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,055 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: new segments: []; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,055 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t4) Installing new cache topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,054 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,054 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,054 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,055 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 20 14:54:29,055 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,054 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,054 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,054 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling transaction data received for topology 20 14:54:29,055 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Removing no longer owned entries for cache ___defaultcache 14:54:29,054 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling topology 20 is installed 14:54:29,055 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,054 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 14:54:29,054 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t6) Updating local topology for cache opt-cache: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,055 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#7 14:54:29,053 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#7 14:54:29,053 DEBUG [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Queueing rebalance for cache ___defaultcache with members [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,053 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=7], TP: [cluster_name=ISPN] 14:54:29,055 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Rebalancing consistent hash for cache ___defaultcache, members are [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,053 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,055 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#7 14:54:29,055 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#7 14:54:29,055 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,055 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,055 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,055 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#7 14:54:29,055 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,055 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:29,055 DEBUG [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating availability for cache ___defaultcache: DEGRADED_MODE -> AVAILABLE 14:54:29,055 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,055 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,055 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@434f4980 passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=true, cache=Cache '___defaultcache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,055 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling transaction data received for topology 20 14:54:29,056 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Removing no longer owned entries for cache ___defaultcache 14:54:29,056 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) On stable topology update. Pending txs: 0 14:54:29,056 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Ignoring late consistent hash update for cache opt-cache, current topology is 21: CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,055 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,055 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,056 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,056 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeD-25447) test-NodeC-10992 used 3340 credits, 1986637 remaining 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,055 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeC-10992 used 3336 credits, 1983301 remaining 14:54:29,056 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,055 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 15 14:54:29,056 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t4) (isRunning=true) Installed new topology 20: CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 20 14:54:29,056 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling topology 20 is installed 14:54:29,056 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeA-55522) test-NodeC-10992 used 3334 credits, 1989988 remaining 14:54:29,056 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (Controller-remote-thread-test-NodeC) Checking if transaction data was received for topology 16, current topology is 20 14:54:29,056 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 3340 credits, 1989982 remaining 14:54:29,056 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255} 14:54:29,056 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,056 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeC) Tasks to be executed=3, still pending=~3 14:54:29,056 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t6) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=16, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:29,056 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Updating cache ___defaultcache topology for rebalance: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeC-p146-t6) Processing completed transaction GlobalTx:test-NodeA-55522:15 14:54:29,055 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,055 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@434f4980 passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=false, cache=Cache '___defaultcache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:29,056 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating stable topology for cache ___defaultcache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t4) Calling perform() on VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} 14:54:29,056 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,055 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeD-25447) test-NodeC-10992 used 3336 credits, 1986641 remaining 14:54:29,055 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,055 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t4) Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=2147483647, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:29,055 TRACE [org.jgroups.protocols.MFC] (jgroups-8,test-NodeA-55522) test-NodeC-10992 used 3336 credits, 1989986 remaining 14:54:29,055 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,056 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#7 14:54:29,056 TRACE [org.infinispan.commands.tx.PrepareCommand] (remote-thread-test-NodeC-p146-t4) Invoking remotely originated prepare: VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab 14:54:29,056 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,056 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t4) Invoked with command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:29,056 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,057 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,057 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeA-55522) test-NodeC-10992 used 3342 credits, 1983304 remaining 14:54:29,057 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t4) handleTxCommand for command VersionedPrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], onePhaseCommit=false, retried=true, versionsSeen={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=13, version=1}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=13, version=1}}, gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache'}, origin test-NodeA-55522 14:54:29,056 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,056 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:29,057 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache ___defaultcache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,057 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 20: CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,057 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 20 is installed 14:54:29,057 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t4) Exists in context? null 14:54:29,057 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,057 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t4) Exists in context? null 14:54:29,056 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t6) Removed remote transaction GlobalTx:test-NodeA-55522:15 ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=13}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(51ecb641){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(7a4c1b3f){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], lookedUpEntriesTopology=14, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:29,057 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t4) Invoking: VersionedPrepareCommand 14:54:29,056 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,056 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,056 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 20: CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,057 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 20 is installed 14:54:29,057 TRACE [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] (remote-thread-test-NodeC-p146-t5) About to execute tx command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,057 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t6) Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=VersionedRepeatableReadEntry(51ecb641){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=VersionedRepeatableReadEntry(7a4c1b3f){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}}}, lockedKeys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}], backupKeyLocks=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}], lookedUpEntriesTopology=14, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} from transaction table. 14:54:29,057 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeC-p146-t6) Transaction GlobalTx:test-NodeA-55522:15 has completed, notifying listening threads. 14:54:29,057 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,057 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,056 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t4) Initialized topology confirmation collector 22@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:29,057 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t6) Marking transaction GlobalTx:test-NodeA-55522:15 as completed 14:54:29,056 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,057 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,057 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeC-p146-t6) Invoking forward of TxCompletionNotification for transaction GlobalTx:test-NodeA-55522:15. Affected keys: [MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}] 14:54:29,057 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t5) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b7fe5aab] 14:54:29,057 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t1) Cache ___defaultcache topology updated: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,057 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeC-p146-t4) Verifying transaction: alreadyCompleted=false 14:54:29,057 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t4) ISPN000310: Starting cluster-wide rebalance for cache opt-cache, topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,057 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t5) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}}, origin test-NodeA-55522 14:54:29,057 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,057 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeC-p146-t4) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:29,057 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t4) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100002: Started rebalance with topology id 22 14:54:29,057 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeC-10992 used 3342 credits, 1979959 remaining 14:54:29,057 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,057 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,057 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t1) Initialized topology confirmation collector 22@___defaultcache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:29,057 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,057 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,057 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t1) ISPN000310: Starting cluster-wide rebalance for cache ___defaultcache, topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,057 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,057 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,057 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t1) [Context=___defaultcache][Scope=test-NodeC-10992]ISPN100002: Started rebalance with topology id 22 14:54:29,057 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,057 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,057 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeC-10992 used 3342 credits, 1979959 remaining 14:54:29,058 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Removing no longer owned entries for cache opt-cache 14:54:29,058 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,058 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,058 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = false, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,058 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 21 is installed 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: new segments: []; old segments: [] 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 21 14:54:29,058 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,058 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:29,058 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,058 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Starting local rebalance for cache ___defaultcache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,056 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t6) Installing new cache topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,058 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,058 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending test-NodeC-10992#9 14:54:29,058 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,058 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 14:54:29,058 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,058 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,058 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,058 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t6) (isRunning=true) Installed new topology 20: CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t6) Signalling topology 20 is installed 14:54:29,058 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t1) test-NodeC-10992 used 6567 credits, 1973392 remaining 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255} 14:54:29,058 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=6567 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,058 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=6567 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,057 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 21 is installed 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t6) Signalling transaction data received for topology 20 14:54:29,058 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#9 14:54:29,058 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,058 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#9 14:54:29,057 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending test-NodeC-10992#8 14:54:29,057 TRACE [org.infinispan.interceptors.impl.QueueAsyncInvocationStage] (remote-thread-test-NodeC-p146-t4) Resuming invocation of command VersionedCommitCommand{gtx=GlobalTx:test-NodeA-55522:15, cacheName='opt-cache', topologyId=16, updatedVersions={MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=SimpleClusteredVersion{topologyId=16, version=2}, MagicKey#k1{8/537A1109/107@test-NodeB-18592}=SimpleClusteredVersion{topologyId=16, version=2}}} with 4 handlers 14:54:29,058 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,057 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-thread-test-NodeC-p146-t6) CommandTopologyId=16, localTopologyId=20 14:54:29,058 TRACE [org.infinispan.interceptors.impl.TxInterceptor] (remote-thread-test-NodeC-p146-t4) Transaction GlobalTx:test-NodeA-55522:15 already completed, skipping commit 14:54:29,058 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Removing no longer owned entries for cache opt-cache 14:54:29,058 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (remote-thread-test-NodeC-p146-t6) Forwarding command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} to new targets [test-NodeD-25447, test-NodeB-18592] 14:54:29,059 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,059 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 invoking TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} to recipient list [test-NodeD-25447, test-NodeB-18592] with options RpcOptions{timeout=15000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=ASYNCHRONOUS} 14:54:29,059 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,059 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Topology changed, recalculating minTopologyId 14:54:29,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 sending command to [test-NodeD-25447, test-NodeB-18592]: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 --> DATA(test-NodeD-25447: #6, conn_id=2) 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (transport-thread-test-NodeC-p148-t5) Invoked with command InvalidateCommand{keys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@22b4dfa4] 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 --> DATA(test-NodeB-18592: #16, conn_id=1) 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=6, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #6, conn_id=2) 14:54:29,059 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (remote-thread-test-NodeC-p146-t6) Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} is {} 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeC-10992: #32) 14:54:29,057 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #16, conn_id=1) 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=32, ts=15, TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#16 14:54:29,059 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 20 14:54:29,059 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeC-p146-t6) Release locks for keys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]. owner=GlobalTx:test-NodeA-55522:15 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#6 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> XMIT(test-NodeC-10992: #20) 14:54:29,059 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Removing no longer owned entries for cache ___defaultcache 14:54:29,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:29,059 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (transport-thread-test-NodeC-p148-t5) handleNonTxWriteCommand for command InvalidateCommand{keys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]}, topology id -1 14:54:29,059 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Changing minimum topology ID from 19 to 20 14:54:29,059 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,058 TRACE [org.infinispan.statetransfer.TransactionSynchronizerInterceptor] (remote-thread-test-NodeC-p146-t4) Completing tx command release future for RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}, PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[], commandInvocationId=CommandInvocation:local:0, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=null}, successful=true, topologyId=16}], lookedUpEntries={}, lockedKeys=[], backupKeyLocks=[], lookedUpEntriesTopology=16, isMarkedForRollback=false, tx=GlobalTx:test-NodeA-55522:15, state=null} 14:54:29,058 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 14:54:29,058 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#9 14:54:29,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992 sending response for request 28 to test-NodeA-55522: UnsureResponse 14:54:29,058 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=6567 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=9], TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992 --> DATA(test-NodeA-55522: #33, conn_id=0) 14:54:29,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#9 14:54:29,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#9 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:29,058 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache ___defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,059 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 used 6561 credits, 1966831 remaining 14:54:29,058 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 20 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=6561 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#8 14:54:29,059 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Updating cluster members for all the caches. New list is [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:29,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=6561 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 sending request 21 to all: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=test-NodeC-10992, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=-1} 14:54:29,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#8 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=2 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=33, TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992: sending test-NodeC-10992#10 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t3) test-NodeC-10992 used 7 credits, 1966824 remaining 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#10 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=21, rsp_expected=true, NAKACK2: [MSG, seqno=10], TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#10 14:54:29,059 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#10 14:54:29,059 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,059 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,059 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeC-10992 used 6567 credits, 1973392 remaining 14:54:29,060 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) On stable topology update. Pending txs: 0 14:54:29,059 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (transport-thread-test-NodeC-p148-t5) Setting command topology to 20 14:54:29,060 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,059 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} [sender=test-NodeC-10992] 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,060 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,059 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=32, ts=15, TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t6) Release lock for GlobalTx:test-NodeA-55522:15. 14:54:29,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeA-55522: #32, conn-id=0, ts=15) 14:54:29,059 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling transaction data received for topology 20 14:54:29,060 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Exists in context? null 14:54:29,060 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,060 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} [sender=test-NodeC-10992] 14:54:29,060 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-8,test-NodeD-25447) Checking if transaction data was received for topology 20, current topology is 20 14:54:29,060 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,060 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,060 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Removing no longer owned entries for cache ___defaultcache 14:54:29,060 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) On stable topology update. Pending txs: 0 14:54:29,060 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@24143e39 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache '___defaultcache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,060 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:29,060 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeD-p154-t5) Processing completed transaction GlobalTx:test-NodeA-55522:15 14:54:29,060 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeD-p154-t5) Removed remote transaction GlobalTx:test-NodeA-55522:15 ? null 14:54:29,060 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 21 from test-NodeC-10992: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#9 14:54:29,060 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeC-10992] 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#10 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#10 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=6561 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=8], TP: [cluster_name=ISPN] 14:54:29,059 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #33, conn_id=0) 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#8 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#10 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 21 to test-NodeC-10992: SuccessfulResponse(true) 14:54:29,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#8 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-9,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,059 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,059 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992 sending response for request 23 to test-NodeA-55522: UnsureResponse 14:54:29,060 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-9,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,059 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#8 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992 --> DATA(test-NodeA-55522: #34, conn_id=0) 14:54:29,060 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-9,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,060 TRACE [org.jgroups.protocols.MFC] (jgroups-9,test-NodeB-18592) test-NodeC-10992 used 6567 credits, 1973392 remaining 14:54:29,059 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=6794 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=20, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeC-10992: #7, conn_id=2) 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received request 21 from test-NodeC-10992: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#8 14:54:29,060 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeC-10992] 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 21 from test-NodeC-10992: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 21 to test-NodeC-10992: SuccessfulResponse(true) 14:54:29,060 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#33 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #7, conn_id=2) 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,060 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,060 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) On stable topology update. Pending txs: 0 14:54:29,060 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeD-25447) test-NodeC-10992 used 7 credits, 1973385 remaining 14:54:29,060 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeD-p154-t5) Marking transaction GlobalTx:test-NodeA-55522:15 as completed 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,060 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t6) Updating local topology for cache opt-cache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-9,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,060 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Updating local topology for cache ___defaultcache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,060 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,060 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,060 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeB-18592) [Notifier] Checking command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} . 14:54:29,060 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t6) State changed for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}. ACQUIRED => RELEASED 14:54:29,061 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeB-18592) Checking if transaction data was received for topology 20, current topology is 20 14:54:29,061 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,061 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t6) Release lock for LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}? true 14:54:29,061 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t6) Try acquire. Next in queue=null. Current=LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15} 14:54:29,061 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,061 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:29,061 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Updated context entry null -> VersionedRepeatableReadEntry(268b5f2a){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,061 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Exists in context? null 14:54:29,061 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,061 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:29,061 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeC-p148-t5) Updated context entry null -> VersionedRepeatableReadEntry(6389d59f){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,061 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (transport-thread-test-NodeC-p148-t5) Invoking: InvalidateCommand 14:54:29,061 TRACE [org.infinispan.commands.write.InvalidateCommand] (transport-thread-test-NodeC-p148-t5) Invalidating keys [MagicKey#k1{8/537A1109/107@test-NodeB-18592}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}] 14:54:29,061 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (transport-thread-test-NodeC-p148-t5) About to commit entry VersionedRepeatableReadEntry(6389d59f){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, isCreated=false, isChanged=true, isRemoved=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,061 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t5) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=null, L1 invalidation=false 14:54:29,061 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t5) Committing key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:29,062 TRACE [org.infinispan.container.DefaultDataContainer] (transport-thread-test-NodeC-p148-t5) Removed MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} from container 14:54:29,062 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (transport-thread-test-NodeC-p148-t5) About to commit entry VersionedRepeatableReadEntry(268b5f2a){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, isCreated=false, isChanged=true, isRemoved=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} 14:54:29,062 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t5) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=null, L1 invalidation=false 14:54:29,062 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t5) Committing key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:29,062 TRACE [org.infinispan.container.DefaultDataContainer] (transport-thread-test-NodeC-p148-t5) Removed MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=init-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=13, version=1}}} from container 14:54:29,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Removed 2 keys, data container now has 0 keys 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,062 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Topology changed, recalculating minTopologyId 14:54:29,062 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Minimum topology ID still is 15; nothing to change 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,062 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,062 DEBUG [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating availability for cache opt-cache: DEGRADED_MODE -> AVAILABLE 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@2c73345a passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.stream.impl.PartitionAwareClusterStreamManager$PartitionListener@2c73345a passing event EventImpl{type=PARTITION_STATUS_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, key=null, value=null, oldValue=null, transaction=null, originLocal=true, transactionSuccessful=false, entries=null, created=false} 14:54:29,062 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating stable topology for cache opt-cache: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,062 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,062 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) On stable topology update. Pending txs: 0 14:54:29,062 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating local topology for cache opt-cache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,062 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,062 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t5) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = false, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,062 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t5) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,062 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling topology 21 is installed 14:54:29,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: new segments: []; old segments: [] 14:54:29,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,062 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,062 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling transaction data received for topology 21 14:54:29,062 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:29,062 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:29,062 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,062 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Topology changed, recalculating minTopologyId 14:54:29,062 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Minimum topology ID still is 15; nothing to change 14:54:29,062 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,062 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,062 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) On stable topology update. Pending txs: 0 14:54:29,062 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating local topology for cache opt-cache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,063 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,063 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,063 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,063 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t5) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,063 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,063 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,063 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@2eec5549 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,063 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t5) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Start keeping track of keys for rebalance 14:54:29,063 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,063 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t5) Tracking is disabled. Clear tracker: {} 14:54:29,063 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t5) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,063 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling topology 22 is installed 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: [] 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) On cache opt-cache we have: added segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; removed segments: {} 14:54:29,063 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Adding inbound state transfer for segments {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Requesting transactions from node test-NodeA-55522 for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,063 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,063 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 sending request 22 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,063 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 --> DATA(test-NodeA-55522: #35, conn_id=0) 14:54:29,063 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t6) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,060 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,060 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,060 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-19,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=2 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=34, TP: [cluster_name=ISPN] 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Start keeping track of keys for rebalance 14:54:29,063 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,060 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,060 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Updating local topology for cache opt-cache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#7 14:54:29,063 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,060 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received response for request 28 from test-NodeC-10992: UnsureResponse 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,063 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-8,test-NodeA-55522) Ignoring response for non-existent request 28 from test-NodeC-10992: UnsureResponse 14:54:29,060 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,063 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t6) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #21, conn_id=1) 14:54:29,063 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t6) Signalling topology 21 is installed 14:54:29,060 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,063 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeC-10992] 14:54:29,060 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeA-55522) test-NodeC-10992 used 6567 credits, 1973403 remaining 14:54:29,060 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,063 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=311 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:29,060 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #20, conn_id=1) 14:54:29,063 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #35, conn_id=0) 14:54:29,060 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,064 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,063 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 21 to test-NodeC-10992: SuccessfulResponse(true) 14:54:29,064 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeB-18592) test-NodeC-10992 used 7 credits, 1973385 remaining 14:54:29,064 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,063 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 7 credits, 1979963 remaining 14:54:29,063 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255} 14:54:29,064 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,064 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeA-55522) test-NodeC-10992 used 6561 credits, 1966835 remaining 14:54:29,063 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,063 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 21 14:54:29,063 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,064 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 21 from test-NodeD-25447: SuccessfulResponse(true) 14:54:29,063 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t4) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,061 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t6) Lock Owner CAS(LockPlaceHolder{lockState=RELEASED, owner=GlobalTx:test-NodeA-55522:15}, null) => true 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,061 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=20, gtx=GlobalTx:test-NodeA-55522:15, cacheName=opt-cache} 14:54:29,061 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.util.concurrent.locks.impl.InfinispanLock] (remote-thread-test-NodeC-p146-t6) Try acquire. Next in queue=null. Current=null 14:54:29,064 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,064 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Removing no longer owned entries for cache ___defaultcache 14:54:29,064 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #34, conn_id=0) 14:54:29,064 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,064 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#34 14:54:29,064 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,064 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Removing no longer owned entries for cache opt-cache 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,064 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,064 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeC-10992: #17, conn_id=1) 14:54:29,064 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,063 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#35 14:54:29,064 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-19,test-NodeA-55522) test-NodeA-55522 received response for request 23 from test-NodeC-10992: UnsureResponse 14:54:29,064 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-19,test-NodeA-55522) Ignoring response for non-existent request 23 from test-NodeC-10992: UnsureResponse 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,064 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Topology changed, recalculating minTopologyId 14:54:29,064 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Changing minimum topology ID from 19 to 20 14:54:29,064 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,064 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #21, conn_id=1) 14:54:29,064 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#21 14:54:29,064 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 21 from test-NodeA-55522: SuccessfulResponse(true) 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=20} 14:54:29,064 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t6) Tracking is disabled. Clear tracker: {} 14:54:29,064 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t6) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,064 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeC-10992 used 6561 credits, 1966824 remaining 14:54:29,064 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 21 is installed 14:54:29,064 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t4) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] (remote-thread-test-NodeB-p138-t4) Processing completed transaction GlobalTx:test-NodeA-55522:15 14:54:29,064 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=20, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t4) Removed remote transaction GlobalTx:test-NodeA-55522:15 ? null 14:54:29,064 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) On stable topology update. Pending txs: 0 14:54:29,064 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeB-p138-t4) Marking transaction GlobalTx:test-NodeA-55522:15 as completed 14:54:29,064 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 22 is installed 14:54:29,064 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received request 22 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t5) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: [] 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache ___defaultcache we have: added segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; removed segments: {} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t6) Signalling transaction data received for topology 21 14:54:29,064 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) On stable topology update. Pending txs: 0 14:54:29,064 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeD-25447) test-NodeC-10992 used 6561 credits, 1966824 remaining 14:54:29,064 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,064 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,064 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Adding inbound state transfer for segments {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,064 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,064 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} [sender=test-NodeC-10992] 14:54:29,064 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache opt-cache: CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,064 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=21, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,064 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling topology 21 is installed 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,064 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Removing no longer owned entries for cache opt-cache 14:54:29,064 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 21 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Adding transfer from test-NodeA-55522 for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,064 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeA) Tasks to be executed=0, still pending=~1 14:54:29,064 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache ___defaultcache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,064 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,064 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Starting local rebalance for cache ___defaultcache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=21, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,064 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,064 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,065 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t5) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Start keeping track of keys for rebalance 14:54:29,065 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,064 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #17, conn_id=1) 14:54:29,065 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Tracking is disabled. Clear tracker: {} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache ___defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t5) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,064 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,064 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Adding transfer from test-NodeB-18592 for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,064 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Removing no longer owned entries for cache ___defaultcache 14:54:29,065 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 sending request 23 to test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,064 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Adding transfer from test-NodeD-25447 for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,065 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling transaction data received for topology 21 14:54:29,065 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Removing no longer owned entries for cache ___defaultcache 14:54:29,065 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) On stable topology update. Pending txs: 0 14:54:29,065 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Updating local topology for cache ___defaultcache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Starting local rebalance for cache ___defaultcache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,065 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,064 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeA-55522) Added a new task to the queue: 1 task(s) are waiting 14:54:29,065 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t4) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Finished adding inbound state transfer for segments {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,065 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 --> DATA(test-NodeA-55522: #36, conn_id=0) 14:54:29,065 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 21: CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Topology changed, recalculating minTopologyId 14:54:29,065 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling topology 22 is installed 14:54:29,065 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Changing minimum topology ID from 20 to 21 14:54:29,065 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:29,065 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeA) Tasks to be executed=1, still pending=~1 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache opt-cache we have: added segments: {159 168}; removed segments: {} 14:54:29,065 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,065 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,065 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@30979069 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache '___defaultcache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,065 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Received new topology for cache ___defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) On stable topology update. Pending txs: 0 14:54:29,065 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=317 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:29,065 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #36, conn_id=0) 14:54:29,065 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#36 14:54:29,065 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t6) Updating local topology for cache opt-cache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received request 23 from test-NodeC-10992: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,065 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t4) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@39404c3d passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache '___defaultcache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,065 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t6) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t4) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Start keeping track of keys for rebalance 14:54:29,065 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,065 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t4) Tracking is disabled. Clear tracker: {} 14:54:29,065 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t4) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,065 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling topology 22 is installed 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: added segments: {58 108 222}; removed segments: {} 14:54:29,065 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Adding inbound state transfer for segments {58 108 222} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Adding transfer from test-NodeA-55522 for segments {58 108} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Adding transfer from test-NodeB-18592 for segments {222} 14:54:29,066 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {58 108} 14:54:29,065 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 21 is installed 14:54:29,065 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,065 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) On stable topology update. Pending txs: 0 14:54:29,066 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Finished adding inbound state transfer for segments {58 108 222} 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,065 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,066 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,065 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} [sender=test-NodeC-10992] 14:54:29,065 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,066 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Starting local rebalance for cache ___defaultcache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,066 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeA-55522) Added a new task to the queue: 1 task(s) are waiting 14:54:29,065 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Received request for transactions from node test-NodeC-10992 for cache opt-cache, topology id 22, segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,066 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeA) Tasks to be executed=0, still pending=~1 14:54:29,065 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Adding inbound state transfer for segments {159 168} 14:54:29,065 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#17 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Requesting transactions from node test-NodeB-18592 for segments {168} 14:54:29,066 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,066 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Found 0 transaction(s) to transfer 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Start keeping track of keys for rebalance 14:54:29,066 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending request 27 to test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} 14:54:29,066 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 22 to test-NodeC-10992: SuccessfulResponse([]) 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #22, conn_id=1) 14:54:29,066 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 21 14:54:29,066 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 22 14:54:29,066 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t6) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,066 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,066 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,066 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #41, conn_id=0) 14:54:29,066 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,066 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,066 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={168}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,066 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,066 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 sending request 29 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={168}} 14:54:29,066 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 21 from test-NodeB-18592: SuccessfulResponse(true) 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,066 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,066 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,066 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,066 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,066 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling transaction data received for topology 22 14:54:29,066 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,066 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t1) Tracking is disabled. Clear tracker: {} 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 --> DATA(test-NodeB-18592: #35, conn_id=0) 14:54:29,066 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,066 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:29,066 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=22, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #22, conn_id=1) 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#22 14:54:29,066 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received response for request 22 from test-NodeA-55522: SuccessfulResponse([]) 14:54:29,066 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:29,066 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t5) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,066 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) On stable topology update. Pending txs: 0 14:54:29,066 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t1) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,066 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=35, TP: [cluster_name=ISPN] 14:54:29,066 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=59 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #35, conn_id=0) 14:54:29,066 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Removing no longer owned entries for cache opt-cache 14:54:29,066 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Received new topology for cache ___defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,066 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@6342a1e4 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#35 14:54:29,067 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Cluster members updated for cache opt-cache, no abrupt leavers detected: cache members = [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447]. Existing members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,067 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t3) Cache opt-cache did not lose any members, ignoring view change 14:54:29,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 29 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={168}} 14:54:29,067 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@69b2f2d1 passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache '___defaultcache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,066 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #41, conn_id=0) 14:54:29,067 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t3) Cluster members updated for cache ___defaultcache, no abrupt leavers detected: cache members = [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447]. Existing members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447] 14:54:29,067 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t6) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,067 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={168}} [sender=test-NodeA-55522] 14:54:29,067 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:29,067 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t5) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,067 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={168}}. 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Start keeping track of keys for rebalance 14:54:29,067 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Start keeping track of keys for rebalance 14:54:29,067 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeB) Tasks to be executed=0, still pending=~1 14:54:29,067 DEBUG [org.infinispan.partitionhandling.impl.PreferConsistencyStrategy] (transport-thread-test-NodeC-p148-t3) Cache ___defaultcache did not lose any members, ignoring view change 14:54:29,067 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 22 is installed 14:54:29,067 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#41 14:54:29,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,067 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Topology changed, recalculating minTopologyId 14:54:29,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t6) Tracking is disabled. Clear tracker: {} 14:54:29,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received request 27 from test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} 14:54:29,067 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task to the queue: 1 task(s) are waiting 14:54:29,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t5) Tracking is disabled. Clear tracker: {} 14:54:29,067 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} [sender=test-NodeD-25447] 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Requesting transactions from node test-NodeB-18592 for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-158 160-161 169-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t6) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,067 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Changing minimum topology ID from 20 to 21 14:54:29,067 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeA) Tasks to be executed=1, still pending=~1 14:54:29,067 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t6) Signalling topology 22 is installed 14:54:29,067 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t6) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,067 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionConsistentHash=null, newTopologyId=21} 14:54:29,067 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 59-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 109-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 223-224 227-234 237-245 248-250 254-255} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache ___defaultcache we have: added segments: {159 168}; removed segments: {} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Starting outbound transfer to node test-NodeD-25447 for cache ___defaultcache, topology id 22, segments {58 108} 14:54:29,067 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,067 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,067 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t5) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,067 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=21, rebalanceId=5, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) On cache opt-cache we have: added segments: {58 108 222}; removed segments: {} 14:54:29,067 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) On stable topology update. Pending txs: 0 14:54:29,067 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Starting outbound transfer to node test-NodeC-10992 for cache ___defaultcache, topology id 22, segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,067 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Adding inbound state transfer for segments {159 168} 14:54:29,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 sending request 24 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling topology 22 is installed 14:54:29,067 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Adding inbound state transfer for segments {58 108 222} 14:54:29,067 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 --> DATA(test-NodeB-18592: #17, conn_id=1) 14:54:29,067 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Adding outbound transfer to test-NodeD-25447 for segments [58, 108] 14:54:29,067 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache opt-cache: CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,067 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeB) Tasks to be executed=0, still pending=~1 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Requesting transactions from node test-NodeA-55522 for segments {58 108} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,067 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Starting local rebalance for cache opt-cache, topology = CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Adding transfer from test-NodeB-18592 for segments {168} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) On cache ___defaultcache we have: added segments: {134-135 158 174}; removed segments: {} 14:54:29,067 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={58 108}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t6) Adding outbound transfer to test-NodeC-10992 for segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,067 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {168} 14:54:29,067 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,067 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,067 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 sending response for request 23 to test-NodeC-10992: SuccessfulResponse(null) 14:54:29,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 sending request 30 to test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} 14:54:29,067 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 --> DATA(test-NodeB-18592: #36, conn_id=0) 14:54:29,067 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t4) Sending last chunk to node test-NodeC-10992 containing 0 cache entries from segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,067 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,068 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 sending request 28 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={58 108}} 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 --> DATA(test-NodeA-55522: #42, conn_id=0) 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=293 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=22, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #17, conn_id=1) 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#17 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 24 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,068 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} [sender=test-NodeC-10992] 14:54:29,068 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,067 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Adding inbound state transfer for segments {134-135 158 174} 14:54:29,067 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Adding transfer from test-NodeD-25447 for segments {159} 14:54:29,068 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}}. 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Adding transfer from test-NodeA-55522 for segments {158} 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending request 31 to test-NodeC-10992: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Finished adding inbound state transfer for segments {159 168} 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t3) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {158} 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,068 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,067 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [58, 108] 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 sending request 33 to test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} 14:54:29,068 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #65, conn_id=0) 14:54:29,067 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 27 to test-NodeD-25447: SuccessfulResponse(null) 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 sending request 32 to test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=53 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:29,067 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522 --> DATA(test-NodeC-10992: #23, conn_id=1) 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #27, conn_id=2) 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=65, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 22 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Adding transfer from test-NodeD-25447 for segments {134-135 174} 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Finished adding inbound state transfer for segments {134-135 158 174} 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache opt-cache, isRebalance = true, isMember = true, topology = CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-19,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=53 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=65, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t5) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #65, conn_id=0) 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#65 14:54:29,068 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t5) Signalling transaction data received for topology 22 14:54:29,068 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,068 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeB) Tasks to be executed=0, still pending=~2 14:54:29,068 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) On stable topology update. Pending txs: 0 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 --> DATA(test-NodeD-25447: #28, conn_id=2) 14:54:29,068 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeB) Tasks to be executed=0, still pending=~2 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #42, conn_id=0) 14:54:29,068 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#42 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received request 28 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={58 108}} 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-19,test-NodeA-55522) test-NodeA-55522 received request 33 from test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} 14:54:29,068 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=22} 14:54:29,068 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task to the queue: 2 task(s) are waiting 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #24, conn_id=1) 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=53 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=36, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=68 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=28, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-19,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} [sender=test-NodeB-18592] 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #28, conn_id=2) 14:54:29,068 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={58 108}} [sender=test-NodeD-25447] 14:54:29,068 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-19,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,068 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} 14:54:29,068 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=27, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Starting outbound transfer to node test-NodeB-18592 for cache ___defaultcache, topology id 22, segments {158} 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #27, conn_id=2) 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t6) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#27 14:54:29,068 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Adding outbound transfer to test-NodeB-18592 for segments [158] 14:54:29,068 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) On stable topology update. Pending txs: 0 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received response for request 27 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,068 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={58 108}} 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#28 14:54:29,068 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t5) Received request for transactions from node test-NodeD-25447 for cache opt-cache, topology id 22, segments {58 108} 14:54:29,068 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 22: CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #36, conn_id=0) 14:54:29,068 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Start keeping track of keys for rebalance 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t3) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [158] 14:54:29,068 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t5) Found 0 transaction(s) to transfer 14:54:29,068 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,068 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeD-25447) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 33 to test-NodeB-18592: SuccessfulResponse(null) 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=498 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #37, conn_id=0) 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #24, conn_id=1) 14:54:29,068 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {58 108} 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 sending request 33 to test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=23, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 sending response for request 28 to test-NodeD-25447: SuccessfulResponse([]) 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#36 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 --> DATA(test-NodeD-25447: #29, conn_id=2) 14:54:29,068 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 30 from test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} 14:54:29,069 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Tracking is disabled. Clear tracker: {} 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} [sender=test-NodeA-55522] 14:54:29,068 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 32 from test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,069 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 2 task(s) are waiting 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t5) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} 14:54:29,069 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Set track to PUT_FOR_STATE_TRANSFER = true 14:54:29,069 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Starting outbound transfer to node test-NodeA-55522 for cache ___defaultcache, topology id 22, segments {168} 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 22 is installed 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #23, conn_id=1) 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#23 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received response for request 23 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={58 108}, finishedSegments={}, unfinishedSegments={58 108}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4086a948[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 --> DATA(test-NodeB-18592: #38, conn_id=0) 14:54:29,068 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#24 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:29,068 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeC-10992) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,069 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (Controller-remote-thread-test-NodeB) Tasks to be executed=2, still pending=~2 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received request 31 from test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-133 136-137 139-144 148-151 154-155 159-168 171-172 175-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t3) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t5) Adding outbound transfer to test-NodeA-55522 for segments [168] 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} [sender=test-NodeA-55522] 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #38, conn_id=0) 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 sending response for request 30 to test-NodeA-55522: SuccessfulResponse(null) 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592 --> DATA(test-NodeA-55522: #66, conn_id=0) 14:54:29,069 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t2) Sending last chunk to node test-NodeA-55522 containing 0 cache entries from segments [168] 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t5) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=66, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 sending request 34 to test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=66, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t3) Received request for transactions from node test-NodeC-10992 for cache opt-cache, topology id 22, segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #66, conn_id=0) 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} [sender=test-NodeA-55522] 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#66 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={168}} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: added segments: {134-135 158 174}; removed segments: {} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t3) Found 0 transaction(s) to transfer 14:54:29,069 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Received request for transactions from node test-NodeA-55522 for cache opt-cache, topology id 22, segments {168} 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 sending response for request 24 to test-NodeC-10992: SuccessfulResponse([]) 14:54:29,069 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeC-10992) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 --> DATA(test-NodeC-10992: #18, conn_id=1) 14:54:29,069 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 --> DATA(test-NodeA-55522: #67, conn_id=0) 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received response for request 30 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t6) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=29, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #37, conn_id=0) 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#38 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#37 14:54:29,069 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeD-25447) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=24, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 18 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #18, conn_id=1) 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#18 14:54:29,069 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-20,test-NodeA-55522) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 33 from test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Found 0 transaction(s) to transfer 14:54:29,069 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Adding inbound state transfer for segments {134-135 158 174} 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 29 to test-NodeA-55522: SuccessfulResponse([]) 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} [sender=test-NodeA-55522] 14:54:29,069 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {168} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Requesting transactions from node test-NodeA-55522 for segments {158} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-15,test-NodeB-18592) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments={168}, finishedSegments={}, unfinishedSegments={168}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7fc268f7[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,069 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t3) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=67, TP: [cluster_name=ISPN] 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #29, conn_id=2) 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,069 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 24 from test-NodeB-18592: SuccessfulResponse([]) 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 8 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 18 of cache ___defaultcache 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 8 of cache ___defaultcache 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 58 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 2 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 58 of cache ___defaultcache 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 3 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 1 14:54:29,069 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,069 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 33 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 3 of cache ___defaultcache 14:54:29,069 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 42 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 43 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 108 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 44 14:54:29,069 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} is {test-NodeB-18592=SuccessfulResponse([])} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 158 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 37 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 37 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 41 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #67, conn_id=0) 14:54:29,069 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={158}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#29 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, finishedSegments={}, unfinishedSegments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@a31e8e3[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received response for request 28 from test-NodeA-55522: SuccessfulResponse([]) 14:54:29,069 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #68, conn_id=0) 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#67 14:54:29,070 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={58 108}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:29,070 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Applying 0 transactions for cache opt-cache transferred from node test-NodeB-18592 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 39 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 40 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 108 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 158 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t3) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {158} 14:54:29,069 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 2 of cache ___defaultcache 14:54:29,070 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished receiving state for segments {158} 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 40 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Requesting transactions from node test-NodeB-18592 for segments {222} 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-19,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=68, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 39 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 39 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Requesting transactions from node test-NodeD-25447 for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 sending request 35 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={158}} 14:54:29,070 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 40 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={222}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 sending request 25 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,070 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished receiving state for segments {58 108} 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992 --> DATA(test-NodeD-25447: #7, conn_id=2) 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #68, conn_id=0) 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 sending request 29 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={222}} 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t5) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 0 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments={158}, finishedSegments={158}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4fd1fdfb[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 38 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 --> DATA(test-NodeA-55522: #69, conn_id=0) 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Inbound transfer finished: InboundTransferTask{segments={158}, finishedSegments={158}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4fd1fdfb[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received request 34 from test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 45 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 45 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 37 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=233 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=7, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Inbound transfer finished: InboundTransferTask{segments={58 108}, finishedSegments={58 108}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4086a948[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#68 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #7, conn_id=2) 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Removing inbound transfers from node {58 108} for segments test-NodeA-55522 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 48 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 47 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 47 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 55 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 36 14:54:29,070 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} [sender=test-NodeB-18592] 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 49 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,070 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-20,test-NodeA-55522) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 49 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Removing inbound transfers from node {158} for segments test-NodeA-55522 14:54:29,070 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,070 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {222} 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,070 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t3) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {134-135 174} 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=69, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #69, conn_id=0) 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 0 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 sending request 36 to test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 48 of cache ___defaultcache 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#7 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 --> DATA(test-NodeB-18592: #16, conn_id=1) 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-19,test-NodeA-55522) test-NodeA-55522 received response for request 29 from test-NodeB-18592: SuccessfulResponse([]) 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 34 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592 --> DATA(test-NodeD-25447: #16, conn_id=2) 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 55 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-19,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={168}} is {test-NodeB-18592=SuccessfulResponse([])} 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t3) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#69 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Segments not received yet for cache ___defaultcache: {test-NodeB-18592=[InboundTransferTask{segments={222}, finishedSegments={}, unfinishedSegments={222}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7ec1698[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache}]} 14:54:29,070 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Applying 0 transactions for cache opt-cache transferred from node test-NodeB-18592 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Segments not received yet for cache ___defaultcache: {test-NodeD-25447=[InboundTransferTask{segments={134-135 174}, finishedSegments={}, unfinishedSegments={134-135 174}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@337ea568[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache}]} 14:54:29,070 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,070 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t5) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 sending response for request 33 to test-NodeA-55522: null 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 35 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending request 30 to test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=65 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #16, conn_id=2) 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeB-18592: #17, conn_id=1) 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#16 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #70, conn_id=0) 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received request 35 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={158}} 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 36 from test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Requesting transactions from node test-NodeD-25447 for segments {159} 14:54:29,070 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={159}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 32 to test-NodeA-55522: null 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 sending request 34 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={159}} 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 --> DATA(test-NodeD-25447: #30, conn_id=2) 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,070 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received request 25 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=70, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} [sender=test-NodeC-10992] 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=16, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #16, conn_id=1) 14:54:29,070 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeA-55522: #43, conn_id=0) 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 168 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 168 of cache ___defaultcache 14:54:29,070 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 33 14:54:29,071 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished receiving state for segments {168} 14:54:29,070 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} [sender=test-NodeB-18592] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Inbound transfer finished: InboundTransferTask{segments={168}, finishedSegments={168}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7fc268f7[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,071 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,070 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={158}} [sender=test-NodeB-18592] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Removing inbound transfers from node {168} for segments test-NodeB-18592 14:54:29,071 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={158}} 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 0 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,071 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {159} 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t5) Segments not received yet for cache ___defaultcache: {test-NodeD-25447=[InboundTransferTask{segments={159}, finishedSegments={}, unfinishedSegments={159}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4716f985[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache}]} 14:54:29,071 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 sending response for request 34 to test-NodeB-18592: null 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 --> DATA(test-NodeB-18592: #39, conn_id=0) 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=30, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 58 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#16 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 29 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={222}} 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Received request for transactions from node test-NodeC-10992 for cache opt-cache, topology id 22, segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #70, conn_id=0) 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #39, conn_id=0) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 86 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#39 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 58 of cache ___defaultcache 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #30, conn_id=2) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 75 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#30 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 75 of cache ___defaultcache 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 82 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 31 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 34 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={159}} 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 91 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 sending request 35 to test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Received request for transactions from node test-NodeB-18592 for cache opt-cache, topology id 22, segments {158} 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-19,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #31, conn_id=2) 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #43, conn_id=0) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Found 0 transaction(s) to transfer 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#43 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 91 of cache ___defaultcache 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 35 to test-NodeB-18592: SuccessfulResponse([]) 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={159}} [sender=test-NodeA-55522] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 32 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={159}} 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received response for request 34 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Found 0 transaction(s) to transfer 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Received request for transactions from node test-NodeA-55522 for cache opt-cache, topology id 22, segments {159} 14:54:29,071 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={222}} [sender=test-NodeD-25447] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 86 of cache ___defaultcache 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#70 14:54:29,071 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeB-18592) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 82 of cache ___defaultcache 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 25 to test-NodeC-10992: SuccessfulResponse([]) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 29 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeC-10992: #8, conn_id=2) 14:54:29,071 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #40, conn_id=0) 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=53 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 28 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-19,test-NodeA-55522) test-NodeA-55522 received response for request 32 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 108 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-19,test-NodeA-55522) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,071 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Completed outbound transfer to node test-NodeD-25447, segments [58, 108] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t5) Starting outbound transfer to node test-NodeB-18592 for cache ___defaultcache, topology id 22, segments {134-135 174} 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #40, conn_id=0) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 108 of cache ___defaultcache 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 111 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 112 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 111 of cache ___defaultcache 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 113 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 26 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #17, conn_id=1) 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t2) Completed outbound transfer to node test-NodeA-55522, segments [168] 14:54:29,071 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received response for request 33 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 30 14:54:29,071 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={222}}. 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Found 0 transaction(s) to transfer 14:54:29,071 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,071 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-20,test-NodeA-55522) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,072 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t3) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={222}} 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t2) Removing completed outbound transfer of segments to test-NodeA-55522 for cache ___defaultcache, segments [168] 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#17 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 113 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 112 of cache ___defaultcache 14:54:29,071 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 27 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 24 14:54:29,071 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#40 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t5) Adding outbound transfer to test-NodeB-18592 for segments [134, 135, 174] 14:54:29,071 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=53 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=31, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,071 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t6) Removing completed outbound transfer of segments to test-NodeD-25447 for cache ___defaultcache, segments [58, 108] 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received response for request 35 from test-NodeA-55522: SuccessfulResponse([]) 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 25 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 30 from test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} 14:54:29,072 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={158}} is {test-NodeA-55522=SuccessfulResponse([])} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 114 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 136 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 114 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 136 of cache ___defaultcache 14:54:29,072 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Applying 0 transactions for cache opt-cache transferred from node test-NodeA-55522 14:54:29,072 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t3) Received request for transactions from node test-NodeD-25447 for cache opt-cache, topology id 22, segments {222} 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=25, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 34 to test-NodeA-55522: SuccessfulResponse([]) 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #8, conn_id=2) 14:54:29,072 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t3) Found 0 transaction(s) to transfer 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #44, conn_id=0) 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Requesting transactions from node test-NodeD-25447 for segments {134-135 174} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 132 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 22 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 115 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 23 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 125 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 125 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t5) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [134, 135, 174] 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 21 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 36 to test-NodeB-18592: SuccessfulResponse(null) 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #31, conn_id=2) 14:54:29,072 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} [sender=test-NodeD-25447] 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#31 14:54:29,072 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 35 from test-NodeA-55522: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} 14:54:29,072 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 115 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 138 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={134-135 174}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 132 of cache ___defaultcache 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#8 14:54:29,072 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t3) Completed outbound transfer to node test-NodeB-18592, segments [158] 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 25 from test-NodeD-25447: SuccessfulResponse([]) 14:54:29,072 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t3) Removing completed outbound transfer of segments to test-NodeB-18592 for cache ___defaultcache, segments [158] 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 19 14:54:29,072 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=GET_TRANSACTIONS, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} is {test-NodeD-25447=SuccessfulResponse([])} 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 sending request 37 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={134-135 174}} 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 sending request 31 to test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,072 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Applying 0 transactions for cache opt-cache transferred from node test-NodeD-25447 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 138 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Adding transfer from test-NodeA-55522 for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 20 14:54:29,072 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} [sender=test-NodeA-55522] 14:54:29,072 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Adding transfer from test-NodeB-18592 for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Starting outbound transfer to node test-NodeD-25447 for cache ___defaultcache, topology id 22, segments {222} 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeB-18592: #18, conn_id=1) 14:54:29,072 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} 14:54:29,072 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 18 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 --> DATA(test-NodeB-18592: #19, conn_id=1) 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 175 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 143 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 143 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 17 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 --> DATA(test-NodeD-25447: #17, conn_id=2) 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 sending response for request 29 to test-NodeD-25447: SuccessfulResponse([]) 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 --> DATA(test-NodeD-25447: #18, conn_id=2) 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=78 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #19, conn_id=1) 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 175 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 173 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Starting outbound transfer to node test-NodeA-55522 for cache ___defaultcache, topology id 22, segments {159} 14:54:29,072 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Adding transfer from test-NodeD-25447 for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,072 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Adding outbound transfer to test-NodeA-55522 for segments [159] 14:54:29,072 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Adding outbound transfer to test-NodeD-25447 for segments [222] 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 sending request 26 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 35 to test-NodeA-55522: SuccessfulResponse(null) 14:54:29,072 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 30 to test-NodeD-25447: SuccessfulResponse(null) 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #45, conn_id=0) 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Finished adding inbound state transfer for segments {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t1) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [222] 14:54:29,073 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 sending request 38 to test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 --> DATA(test-NodeD-25447: #20, conn_id=2) 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 173 of cache ___defaultcache 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=59 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 15 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 16 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 188 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #18, conn_id=1) 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #20, conn_id=2) 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#19 14:54:29,072 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#20 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 188 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 14 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 38 from test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 191 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 177 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 192 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 192 of cache ___defaultcache 14:54:29,072 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t5) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeD-25447: #19, conn_id=2) 14:54:29,072 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t3) Sending last chunk to node test-NodeA-55522 containing 0 cache entries from segments [159] 14:54:29,072 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 --> DATA(test-NodeA-55522: #37, conn_id=0) 14:54:29,073 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t5) Signalling transaction data received for topology 22 14:54:29,073 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 13 14:54:29,073 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #17, conn_id=2) 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 sending request 32 to test-NodeA-55522: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,073 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #18, conn_id=2) 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#17 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 177 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 191 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 12 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeD-25447) test-NodeD-25447 received request 37 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={134-135 174}} 14:54:29,073 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} [sender=test-NodeB-18592] 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#18 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 31 from test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 36 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,073 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={134-135 174}} [sender=test-NodeB-18592] 14:54:29,073 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 11 14:54:29,073 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,073 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,073 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t3) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {134-135 174} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 193 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 195 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments={134-135 174}, finishedSegments={}, unfinishedSegments={134-135 174}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@337ea568[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 195 of cache ___defaultcache 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 --> DATA(test-NodeA-55522: #46, conn_id=0) 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={134-135 174}} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 193 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Received request for transactions from node test-NodeB-18592 for cache opt-cache, topology id 22, segments {134-135 174} 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#18 14:54:29,073 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} [sender=test-NodeD-25447] 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,073 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Found 0 transaction(s) to transfer 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #19, conn_id=2) 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 37 to test-NodeB-18592: SuccessfulResponse([]) 14:54:29,073 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeD-25447) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#19 14:54:29,073 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received response for request 29 from test-NodeB-18592: SuccessfulResponse([]) 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 9 14:54:29,073 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=GET_TRANSACTIONS, topologyId=22, segments={222}} is {test-NodeB-18592=SuccessfulResponse([])} 14:54:29,073 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 10 14:54:29,073 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Applying 0 transactions for cache opt-cache transferred from node test-NodeB-18592 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 223 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 222 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 223 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-15,test-NodeB-18592) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 8 14:54:29,073 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received response for request 30 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,073 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,073 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeD-25447) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,073 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {222} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 134 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={222}, finishedSegments={}, unfinishedSegments={222}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7ec1698[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 134 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 2 14:54:29,073 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeB-18592: #20, conn_id=1) 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 174 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 135 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Adding transfer from test-NodeA-55522 for segments {58 108} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 227 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 196 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 218 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 221 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,073 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Topology changed, recalculating minTopologyId 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 218 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 196 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 227 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 222 of cache ___defaultcache 14:54:29,074 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished receiving state for segments {222} 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 135 of cache ___defaultcache 14:54:29,073 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 174 of cache ___defaultcache 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 1 14:54:29,073 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,074 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {58 108} 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Adding transfer from test-NodeB-18592 for segments {222} 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Inbound transfer finished: InboundTransferTask{segments={222}, finishedSegments={222}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7ec1698[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,074 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Finished adding inbound state transfer for segments {58 108 222} 14:54:29,074 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished receiving state for segments {134-135 174} 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t6) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 5 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #20, conn_id=1) 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 6 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 7 14:54:29,074 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t5) Minimum topology ID still is 15; nothing to change 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 221 of cache ___defaultcache 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 244 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,074 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t6) Signalling transaction data received for topology 22 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Inbound transfer finished: InboundTransferTask{segments={134-135 174}, finishedSegments={134-135 174}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@337ea568[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,074 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Removing inbound transfers from node {134-135 174} for segments test-NodeD-25447 14:54:29,074 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,074 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished receiving of segments for cache ___defaultcache for topology 22. 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,074 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,074 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t4) Tracking is disabled. Clear tracker: {} 14:54:29,074 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,074 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Topology changed, recalculating minTopologyId 14:54:29,074 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t6) Changing minimum topology ID from 21 to 22 14:54:29,074 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 --> DATA(test-NodeC-10992: #19, conn_id=1) 14:54:29,074 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,074 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,074 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,074 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t6) On stable topology update. Pending txs: 0 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,074 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending request 33 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t4) Segments not received yet for cache ___defaultcache: {} 14:54:29,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #19, conn_id=1) 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#19 14:54:29,074 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,074 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeB-18592] 14:54:29,074 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 0 14:54:29,074 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t4) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeB-18592, topology id = 22 14:54:29,074 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 244 of cache ___defaultcache 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 3 14:54:29,074 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t4) [Context=___defaultcache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 22 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 247 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,074 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t4) Rebalance confirmation collector 22@___defaultcache received confirmation for test-NodeB-18592, remaining list is [test-NodeA-55522, test-NodeD-25447, test-NodeC-10992] 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 4 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#20 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 247 of cache ___defaultcache 14:54:29,074 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 254 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 252 of cache ___defaultcache from node test-NodeA-55522: received 0 cache entries 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 252 of cache ___defaultcache 14:54:29,074 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 31 to test-NodeD-25447: null 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Removing inbound transfers from node {222} for segments test-NodeB-18592 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeD-25447: #21, conn_id=2) 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeA-55522: #47, conn_id=0) 14:54:29,074 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,074 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 1 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 254 of cache ___defaultcache 14:54:29,074 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) On stable topology update. Pending txs: 0 14:54:29,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 2 14:54:29,074 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received response for request 37 from test-NodeD-25447: SuccessfulResponse([]) 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #21, conn_id=2) 14:54:29,074 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (remote-thread-test-NodeC-p146-t6) Finished receiving state for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,074 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished receiving of segments for cache ___defaultcache for topology 22. 14:54:29,074 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Inbound transfer finished: InboundTransferTask{segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, finishedSegments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@a31e8e3[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,074 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#21 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Removing inbound transfers from node {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} for segments test-NodeA-55522 14:54:29,075 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 31 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,075 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 0 14:54:29,075 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,075 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t3) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,074 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=GET_TRANSACTIONS, topologyId=22, segments={134-135 174}} is {test-NodeD-25447=SuccessfulResponse([])} 14:54:29,075 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,075 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t5) Completed outbound transfer to node test-NodeB-18592, segments [134, 135, 174] 14:54:29,075 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t5) Removing completed outbound transfer of segments to test-NodeB-18592 for cache ___defaultcache, segments [134, 135, 174] 14:54:29,075 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t1) Tracking is disabled. Clear tracker: {} 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Segments not received yet for cache ___defaultcache: {test-NodeD-25447=[InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={}, unfinishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@75434430[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache}], test-NodeB-18592=[InboundTransferTask{segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, finishedSegments={}, unfinishedSegments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@2b40d73[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache}]} 14:54:29,075 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992 sending request 27 to test-NodeB-18592: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,075 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 sending response for request 31 to test-NodeA-55522: null 14:54:29,075 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992 --> DATA(test-NodeB-18592: #18, conn_id=1) 14:54:29,075 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t3) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 --> DATA(test-NodeA-55522: #38, conn_id=0) 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447 --> DATA(test-NodeC-10992: #9, conn_id=2) 14:54:29,075 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:29,075 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t1) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,075 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=299 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=18, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #18, conn_id=1) 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 0 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Segments not received yet for cache ___defaultcache: {} 14:54:29,075 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 38 to test-NodeB-18592: null 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeB-18592: #21, conn_id=1) 14:54:29,075 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,075 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Applying 0 transactions for cache opt-cache transferred from node test-NodeD-25447 14:54:29,075 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Adding transfer from test-NodeA-55522 for segments {158} 14:54:29,075 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#18 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #9, conn_id=2) 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#9 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Adding transfer from test-NodeD-25447 for segments {134-135 174} 14:54:29,075 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {158} 14:54:29,075 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,075 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeD-25447] 14:54:29,075 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #21, conn_id=1) 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Finished adding inbound state transfer for segments {134-135 158 174} 14:54:29,075 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,075 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 22 14:54:29,075 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,075 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,075 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,075 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Topology changed, recalculating minTopologyId 14:54:29,075 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Changing minimum topology ID from 21 to 22 14:54:29,075 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,075 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,075 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) On stable topology update. Pending txs: 0 14:54:29,075 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-19,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=311 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=37, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #37, conn_id=0) 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-19,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#37 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-8,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=53 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=47, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-19,test-NodeA-55522) test-NodeA-55522 received request 26 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,076 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-19,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} [sender=test-NodeC-10992] 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=58 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=46, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #46, conn_id=0) 14:54:29,076 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-19,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,076 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} 14:54:29,076 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Starting outbound transfer to node test-NodeC-10992 for cache opt-cache, topology id 22, segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,075 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received request 27 from test-NodeC-10992: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#46 14:54:29,076 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Adding outbound transfer to test-NodeC-10992 for segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received request 32 from test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 26 to test-NodeC-10992: SuccessfulResponse(null) 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=45, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #25, conn_id=1) 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #45, conn_id=0) 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#45 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t2) Sending last chunk to node test-NodeC-10992 containing 0 cache entries from segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #47, conn_id=0) 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-8,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#47 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-8,test-NodeA-55522) test-NodeA-55522 received request 33 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} 14:54:29,076 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-8,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} [sender=test-NodeD-25447] 14:54:29,076 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-8,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,076 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=31, rsp_expected=true, UNICAST3: DATA, seqno=38, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 sending request 39 to test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} 14:54:29,076 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Starting outbound transfer to node test-NodeD-25447 for cache opt-cache, topology id 22, segments {58 108} 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=6 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 14:54:29,075 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#21 14:54:29,076 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t4) Adding outbound transfer to test-NodeD-25447 for segments [58, 108] 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 38 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,075 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeD-25447, topology id = 22 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 33 to test-NodeD-25447: SuccessfulResponse(null) 14:54:29,076 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #32, conn_id=2) 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t1) Completed outbound transfer to node test-NodeD-25447, segments [222] 14:54:29,076 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t1) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [58, 108] 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #44, conn_id=0) 14:54:29,076 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-20,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#44 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #38, conn_id=0) 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeA-55522) test-NodeA-55522 received response for request 34 from test-NodeD-25447: SuccessfulResponse([]) 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 sending request 36 to test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,076 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-20,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=GET_TRANSACTIONS, topologyId=22, segments={159}} is {test-NodeD-25447=SuccessfulResponse([])} 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=26, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #25, conn_id=1) 14:54:29,076 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Applying 0 transactions for cache opt-cache transferred from node test-NodeD-25447 14:54:29,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Adding transfer from test-NodeB-18592 for segments {168} 14:54:29,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Adding transfer from test-NodeD-25447 for segments {159} 14:54:29,076 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {168} 14:54:29,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Finished adding inbound state transfer for segments {159 168} 14:54:29,076 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,076 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Topology update processed, stateTransferTopologyId = 22, startRebalance = true, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,076 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling transaction data received for topology 22 14:54:29,076 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,076 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,076 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,076 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Topology changed, recalculating minTopologyId 14:54:29,076 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t5) Changing minimum topology ID from 21 to 22 14:54:29,076 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=22} 14:54:29,077 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) Check if topology CacheTopology{id=22, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,077 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) On stable topology update. Pending txs: 0 14:54:29,076 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #71, conn_id=0) 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 35 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,076 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} [sender=test-NodeD-25447] 14:54:29,076 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} [sender=test-NodeC-10992] 14:54:29,077 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,077 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-17,test-NodeA-55522) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 sending request 38 to test-NodeC-10992: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,076 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 sending request 37 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#25 14:54:29,076 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=33, rsp_expected=true, UNICAST3: DATA, seqno=32, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 26 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 --> DATA(test-NodeD-25447: #33, conn_id=2) 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #32, conn_id=2) 14:54:29,076 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#38 14:54:29,077 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 31 from test-NodeC-10992: SuccessfulResponse(null) 14:54:29,077 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,077 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeA-55522) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:29,076 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t1) Removing completed outbound transfer of segments to test-NodeD-25447 for cache ___defaultcache, segments [222] 14:54:29,077 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t4) Completed outbound transfer to node test-NodeC-10992, segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,076 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) [Context=___defaultcache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 22 14:54:29,077 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t4) Removing completed outbound transfer of segments to test-NodeC-10992 for cache ___defaultcache, segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, finishedSegments={}, unfinishedSegments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4f607d5[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,077 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t6) Rebalance confirmation collector 22@___defaultcache received confirmation for test-NodeD-25447, remaining list is [test-NodeA-55522, test-NodeC-10992] 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#32 14:54:29,077 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 --> DATA(test-NodeB-18592: #41, conn_id=0) 14:54:29,077 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {159} 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=71, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={159}, finishedSegments={}, unfinishedSegments={159}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4716f985[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522 --> DATA(test-NodeC-10992: #26, conn_id=1) 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,077 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,077 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 159 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 159 of cache ___defaultcache 14:54:29,077 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Starting outbound transfer to node test-NodeC-10992 for cache ___defaultcache, topology id 22, segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 33 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,077 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Adding outbound transfer to test-NodeC-10992 for segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,077 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={58 108}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 27 to test-NodeC-10992: SuccessfulResponse(null) 14:54:29,077 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {58 108} 14:54:29,077 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t3) Sending last chunk to node test-NodeC-10992 containing 0 cache entries from segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={58 108}, finishedSegments={}, unfinishedSegments={58 108}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@44b92580[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,077 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished receiving state for segments {159} 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=71, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t2) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #41, conn_id=0) 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #71, conn_id=0) 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#41 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#71 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received request 39 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} 14:54:29,077 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} [sender=test-NodeB-18592] 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 sending request 40 to test-NodeC-10992: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,077 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Inbound transfer finished: InboundTransferTask{segments={159}, finishedSegments={159}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4716f985[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=492 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #26, conn_id=1) 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#26 14:54:29,078 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received request 38 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,078 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} [sender=test-NodeA-55522] 14:54:29,078 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeC-10992) [Blocking] Checking command StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true}. 14:54:29,078 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeC-10992) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,078 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,077 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=62 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=33, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeC-10992: #20, conn_id=1) 14:54:29,077 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Removing inbound transfers from node {159} for segments test-NodeD-25447 14:54:29,078 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 --> DATA(test-NodeC-10992: #21, conn_id=1) 14:54:29,078 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished receiving of segments for cache ___defaultcache for topology 22. 14:54:29,077 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} 14:54:29,078 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,077 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 37 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,078 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} [sender=test-NodeA-55522] 14:54:29,078 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t5) Starting outbound transfer to node test-NodeB-18592 for cache opt-cache, topology id 22, segments {158} 14:54:29,078 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,078 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t4) Tracking is disabled. Clear tracker: {} 14:54:29,078 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeA-p130-t5) Adding outbound transfer to test-NodeB-18592 for segments [158] 14:54:29,078 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 sending response for request 39 to test-NodeB-18592: SuccessfulResponse(null) 14:54:29,078 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,078 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=27, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,078 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [158] 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #33, conn_id=2) 14:54:29,078 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,078 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#33 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #20, conn_id=1) 14:54:29,078 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 sending request 39 to test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #27, conn_id=1) 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 18 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 18 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 44 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 37 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 37 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 43 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 39 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 39 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 42 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 40 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 40 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 41 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 45 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 45 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 40 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 47 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 47 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 39 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 48 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 48 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 38 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 49 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 49 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 37 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 55 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 55 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 36 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 58 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 58 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 35 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 75 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 75 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 34 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 82 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 82 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 33 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 86 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 86 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 32 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 91 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 91 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 31 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 108 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 108 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 30 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 111 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 111 of cache opt-cache 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 29 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 112 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 112 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 28 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 113 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 113 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 27 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 114 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 114 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 26 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 115 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 115 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 25 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 125 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 125 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 24 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 132 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 132 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 23 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 136 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 136 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 22 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 138 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 138 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 21 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 143 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 143 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 20 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 173 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 173 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 19 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 175 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 175 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 18 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 177 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 177 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 17 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 188 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 188 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 16 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 191 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 191 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 15 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 192 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 192 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 14 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 193 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 193 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 13 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 195 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 195 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 12 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 196 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 196 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 11 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 218 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 218 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 10 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 221 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 221 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 9 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 223 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 223 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 8 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 227 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 227 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 7 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 244 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 244 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 6 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 247 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 247 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 5 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 252 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 252 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 4 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 254 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 254 of cache opt-cache 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 3 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522 --> DATA(test-NodeB-18592: #42, conn_id=0) 14:54:29,078 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=468 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,079 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t5) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:29,079 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #21, conn_id=1) 14:54:29,079 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#21 14:54:29,079 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}}. 14:54:29,079 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,079 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:29,078 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 3 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 8 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522 --> DATA(test-NodeB-18592: #43, conn_id=0) 14:54:29,078 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#20 14:54:29,079 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t6) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 0 14:54:29,079 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 27 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 2 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,080 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeC-10992) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 2 of cache opt-cache 14:54:29,080 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 8 of cache opt-cache 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 2 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 36 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=52 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:29,080 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} [sender=test-NodeA-55522] 14:54:29,079 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 3 of cache opt-cache 14:54:29,079 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #42, conn_id=0) 14:54:29,080 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeD-25447) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,079 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 40 from test-NodeB-18592: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,080 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,080 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,080 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished receiving state for segments {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} 14:54:29,080 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t3) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Before applying the received state the data container of cache opt-cache has 1 keys 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #43, conn_id=0) 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#43 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Applying new state chunk for segment 108 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 58 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 39 from test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,080 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} [sender=test-NodeA-55522] 14:54:29,080 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeB-18592) [Notifier] Checking command StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true}. 14:54:29,080 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeB-18592) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,080 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,080 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t3) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Before applying the received state the data container of cache opt-cache has 2 keys 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 1 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 58 of cache opt-cache 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #27, conn_id=1) 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 158 of cache opt-cache from node test-NodeA-55522: received 0 cache entries 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 1 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished applying chunk of segment 108 of cache opt-cache 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Inbound transfer finished: InboundTransferTask{segments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, finishedSegments={2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@4f607d5[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Removing inbound transfers from node {2-3 8 18 37 39-40 45 47-49 55 58 75 82 86 91 108 111-115 125 132 136 138 143 173 175 177 188 191-193 195-196 218 221 223 227 244 247 252 254} for segments test-NodeA-55522 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 0 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, finishedSegments={}, unfinishedSegments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@2b40d73[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#42 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Segments not received yet for cache ___defaultcache: {} 14:54:29,080 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t2) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 32 to test-NodeD-25447: null 14:54:29,080 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #34, conn_id=2) 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t2) test-NodeC-10992 sending request 28 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t2) test-NodeC-10992 --> DATA(test-NodeB-18592: #19, conn_id=1) 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t2) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,080 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t1) Finished receiving state for segments {58 108} 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=293 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=19, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 158 of cache opt-cache 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=32, rsp_expected=true, UNICAST3: DATA, seqno=34, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #19, conn_id=1) 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #34, conn_id=2) 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeB-18592) test-NodeB-18592 received response for request 39 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#19 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#34 14:54:29,080 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Starting outbound transfer to node test-NodeA-55522 for cache opt-cache, topology id 22, segments {168} 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 32 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,080 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Adding outbound transfer to test-NodeA-55522 for segments [168] 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Inbound transfer finished: InboundTransferTask{segments={58 108}, finishedSegments={58 108}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@44b92580[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Removing inbound transfers from node {58 108} for segments test-NodeA-55522 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 37 to test-NodeA-55522: SuccessfulResponse(null) 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t1) Latch 0 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #72, conn_id=0) 14:54:29,080 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {222} 14:54:29,080 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t4) Sending last chunk to node test-NodeA-55522 containing 0 cache entries from segments [168] 14:54:29,080 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,080 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending request 34 to test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeB-18592: #22, conn_id=1) 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,080 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} [sender=test-NodeB-18592] 14:54:29,080 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) After applying the received state the data container of cache opt-cache has 0 keys 14:54:29,081 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeC-10992) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Segments not received yet for cache opt-cache: {test-NodeD-25447=[InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={}, unfinishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@447c1538[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache}], test-NodeB-18592=[InboundTransferTask{segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, finishedSegments={}, unfinishedSegments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7a6102c7[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache}]} 14:54:29,081 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t4) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 sending request 41 to test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 --> DATA(test-NodeA-55522: #73, conn_id=0) 14:54:29,080 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=72, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=73, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 28 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 19 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 19 of cache ___defaultcache 14:54:29,080 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 41 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 6 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 6 of cache ___defaultcache 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 40 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=72, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 7 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #72, conn_id=0) 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 7 of cache ___defaultcache 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=52 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=73, TP: [cluster_name=ISPN] 14:54:29,080 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={158}} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #73, conn_id=0) 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#73 14:54:29,081 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeA-55522 for segments {158} 14:54:29,081 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received request 41 from test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,081 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} [sender=test-NodeB-18592] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeA-55522) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,081 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,081 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,080 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished receiving state for segments {158} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Before applying the received state the data container of cache opt-cache has 1 keys 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 0 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) After applying the received state the data container of cache opt-cache has 2 keys 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={158}, finishedSegments={158}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3a4a340c[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,080 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#27 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Segments not received yet for cache opt-cache: {test-NodeA-55522=[InboundTransferTask{segments={158}, finishedSegments={158}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3a4a340c[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache}], test-NodeD-25447=[InboundTransferTask{segments={134-135 174}, finishedSegments={}, unfinishedSegments={134-135 174}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3db94d77[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache}]} 14:54:29,080 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received request 28 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Inbound transfer finished: InboundTransferTask{segments={158}, finishedSegments={158}, unfinishedSegments={}, source=test-NodeA-55522, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3a4a340c[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,081 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} [sender=test-NodeC-10992] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Removing inbound transfers from node {158} for segments test-NodeA-55522 14:54:29,081 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 sending response for request 39 to test-NodeA-55522: null 14:54:29,081 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}}. 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 --> DATA(test-NodeA-55522: #74, conn_id=0) 14:54:29,081 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,081 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {134-135 174} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Applying new state chunk for segment 168 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished applying chunk of segment 168 of cache opt-cache 14:54:29,081 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t4) Finished receiving state for segments {168} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t4) Latch 0 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 39 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) After applying the received state the data container of cache opt-cache has 1 keys 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#72 14:54:29,081 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 28 of cache ___defaultcache 14:54:29,081 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Starting outbound transfer to node test-NodeC-10992 for cache opt-cache, topology id 22, segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,081 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 sending response for request 38 to test-NodeA-55522: null 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 --> DATA(test-NodeA-55522: #39, conn_id=0) 14:54:29,081 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t4) Adding outbound transfer to test-NodeC-10992 for segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 sending response for request 28 to test-NodeC-10992: SuccessfulResponse(null) 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592 --> DATA(test-NodeC-10992: #22, conn_id=1) 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t4) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) After applying the received state the data container of cache opt-cache has 1 keys 14:54:29,081 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t5) Sending last chunk to node test-NodeC-10992 containing 1 cache entries from segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,081 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=28, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #22, conn_id=1) 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #22, conn_id=1) 14:54:29,081 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,081 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=39, TP: [cluster_name=ISPN] 14:54:29,081 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t3) Completed outbound transfer to node test-NodeA-55522, segments [159] 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Segments not received yet for cache opt-cache: {test-NodeB-18592=[InboundTransferTask{segments={222}, finishedSegments={}, unfinishedSegments={222}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@65015503[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache}]} 14:54:29,081 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t3) Removing completed outbound transfer of segments to test-NodeA-55522 for cache ___defaultcache, segments [159] 14:54:29,081 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 36 to test-NodeA-55522: null 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 38 14:54:29,081 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Segments not received yet for cache opt-cache: {test-NodeD-25447=[InboundTransferTask{segments={159}, finishedSegments={}, unfinishedSegments={159}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@a5f0860[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache}], test-NodeB-18592=[InboundTransferTask{segments={168}, finishedSegments={168}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@236023b[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache}]} 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 31 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 29 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 29 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 37 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 30 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 30 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 36 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received response for request 37 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,081 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 41 to test-NodeB-18592: null 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-17,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={168}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeB-18592: #44, conn_id=0) 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {168} 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 31 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments={168}, finishedSegments={168}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@236023b[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeA-55522: #48, conn_id=0) 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #39, conn_id=0) 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Inbound transfer finished: InboundTransferTask{segments={168}, finishedSegments={168}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@236023b[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,081 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#39 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Removing inbound transfers from node {168} for segments test-NodeB-18592 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 38 from test-NodeC-10992: SuccessfulResponse(null) 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 sending request 42 to test-NodeC-10992: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,082 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {159} 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#22 14:54:29,081 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#22 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=2, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=3, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=8, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=18, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=37, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=39, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=40, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=45, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=47, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=48, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=49, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=55, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=75, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=82, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=86, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=91, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=111, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=112, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=113, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=114, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=115, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=125, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=132, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=136, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=138, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=143, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=173, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=175, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=177, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=188, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=191, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=192, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=193, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=195, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=196, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=218, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=221, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=223, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=227, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=244, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=247, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=252, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=254, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 34 from test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} 14:54:29,082 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} [sender=test-NodeD-25447] 14:54:29,082 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t2) Completed outbound transfer to node test-NodeC-10992, segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,082 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}}. 14:54:29,082 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t2) Removing completed outbound transfer of segments to test-NodeC-10992 for cache opt-cache, segments [2, 3, 8, 18, 37, 39, 40, 45, 47, 48, 49, 55, 58, 75, 82, 86, 91, 108, 111, 112, 113, 114, 115, 125, 132, 136, 138, 143, 173, 175, 177, 188, 191, 192, 193, 195, 196, 218, 221, 223, 227, 244, 247, 252, 254] 14:54:29,082 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,082 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t3) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=41, rsp_expected=true, UNICAST3: DATA, seqno=44, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t3) Starting outbound transfer to node test-NodeD-25447 for cache opt-cache, topology id 22, segments {222} 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeA-55522: #44, conn_id=0) 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeB-p138-t3) Adding outbound transfer to test-NodeD-25447 for segments [222] 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 sending response for request 34 to test-NodeD-25447: SuccessfulResponse(null) 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 35 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 --> DATA(test-NodeD-25447: #22, conn_id=2) 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 sending request 43 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeA-55522#44 14:54:29,082 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t2) Sending last chunk to node test-NodeD-25447 containing 0 cache entries from segments [222] 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 41 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 32 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=48, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 41 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #48, conn_id=0) 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592 --> DATA(test-NodeC-10992: #23, conn_id=1) 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 sending request 44 to test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#48 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t5) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 46 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=39, rsp_expected=true, UNICAST3: DATA, seqno=74, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeA-55522] 14:54:29,082 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,082 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeA-55522, topology id = 22 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 28 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (3 headers), size=670 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #23, conn_id=1) 14:54:29,082 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t2) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeB-18592: #74, conn_id=0) 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 46 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Waiting for inbound transfer to finish: InboundTransferTask{segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, finishedSegments={}, unfinishedSegments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7a6102c7[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=34, rsp_expected=true, UNICAST3: DATA, seqno=22, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 36 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #22, conn_id=2) 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#22 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 41 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 34 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=168, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 33 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 32 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeD-25447, type=START_STATE_TRANSFER, topologyId=22, segments={222}} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 50 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 50 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeB-18592 for segments {222} 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592 --> DATA(test-NodeD-25447: #23, conn_id=2) 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={222}, finishedSegments={}, unfinishedSegments={222}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@65015503[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t4) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeA-55522: #44) 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 32 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeA-55522, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=44, ts=17, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 59 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 57 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 57 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 31 14:54:29,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=59 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 30 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592 --> DATA(test-NodeD-25447: #24, conn_id=2) 14:54:29,082 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=58, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=108, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t2) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 34 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeB-18592#74 14:54:29,083 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t1) Completed outbound transfer to node test-NodeD-25447, segments [58, 108] 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#23 14:54:29,083 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t1) Removing completed outbound transfer of segments to test-NodeD-25447 for cache opt-cache, segments [58, 108] 14:54:29,082 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 sending request 40 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} 14:54:29,082 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) [Context=___defaultcache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 22 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=52 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,083 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t4) Completed outbound transfer to node test-NodeA-55522, segments [168] 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #24, conn_id=2) 14:54:29,083 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received response for request 39 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=44, ts=17, TP: [cluster_name=ISPN] 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #23, conn_id=2) 14:54:29,083 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-17,test-NodeA-55522) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=158, cacheEntries=0, isLastChunk=true}], origin=test-NodeA-55522, topologyId=22, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeB-18592: #44, conn-id=0, ts=17) 14:54:29,083 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeA-p132-t6) Completed outbound transfer to node test-NodeB-18592, segments [158] 14:54:29,082 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeD-25447: #22) 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=18, TP: [cluster_name=ISPN] 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeC-10992: #19) 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=19, conn_id=1, ts=19, TP: [cluster_name=ISPN] 14:54:29,083 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received request 42 from test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=22, conn_id=1, ts=18, TP: [cluster_name=ISPN] 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeB-18592: #22, conn-id=1, ts=18) 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 59 of cache ___defaultcache 14:54:29,082 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 54 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=19, conn_id=1, ts=19, TP: [cluster_name=ISPN] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeA-p132-t6) Removing completed outbound transfer of segments to test-NodeB-18592 for cache opt-cache, segments [158] 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#24 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} [sender=test-NodeB-18592] 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 --> DATA(test-NodeD-25447: #35, conn_id=2) 14:54:29,083 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received request 44 from test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t4) Removing completed outbound transfer of segments to test-NodeA-55522 for cache opt-cache, segments [168] 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} [sender=test-NodeB-18592] 14:54:29,083 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t6) Rebalance confirmation collector 22@___defaultcache received confirmation for test-NodeA-55522, remaining list is [test-NodeC-10992] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeD-25447) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#23 14:54:29,083 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeB-18592: #19, conn-id=1, ts=19) 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 54 of cache ___defaultcache 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 29 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 28 14:54:29,083 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=47 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=35, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 65 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 80 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 66 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #35, conn_id=2) 14:54:29,083 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-21,test-NodeC-10992) [Blocking] Checking command StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true}. 14:54:29,083 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#35 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 80 of cache ___defaultcache 14:54:29,083 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 43 from test-NodeB-18592: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} [sender=test-NodeB-18592] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 65 of cache ___defaultcache 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 26 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t4) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 81 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Before applying the received state the data container of cache opt-cache has 1 keys 14:54:29,083 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Starting outbound transfer to node test-NodeB-18592 for cache opt-cache, topology id 22, segments {134-135 174} 14:54:29,083 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 66 of cache ___defaultcache 14:54:29,083 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-21,test-NodeC-10992) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 25 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 27 14:54:29,083 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received request 40 from test-NodeA-55522: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} 14:54:29,083 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t4) Adding outbound transfer to test-NodeB-18592 for segments [134, 135, 174] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 81 of cache ___defaultcache 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 24 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t6) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 89 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Before applying the received state the data container of cache opt-cache has 0 keys 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} [sender=test-NodeA-55522] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 107 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,083 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t1) Sending last chunk to node test-NodeB-18592 containing 0 cache entries from segments [134, 135, 174] 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 83 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 83 of cache ___defaultcache 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 107 of cache opt-cache from node test-NodeB-18592: received 1 cache entries 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 89 of cache ___defaultcache 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Applying new state chunk for segment 222 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 22 14:54:29,083 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 sending response for request 43 to test-NodeB-18592: SuccessfulResponse(null) 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 137 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 137 of cache ___defaultcache 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447 --> DATA(test-NodeB-18592: #23, conn_id=1) 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 109 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,083 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} to recipient list [test-NodeB-18592] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 23 14:54:29,083 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t6) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} 14:54:29,083 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 107 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 sending request 35 to test-NodeB-18592: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 109 of cache ___defaultcache 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t4) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t6) Created a new local transaction: LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@12 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 21 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished applying chunk of segment 222 of cache opt-cache 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 162 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished receiving state for segments {222} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Inbound transfer finished: InboundTransferTask{segments={222}, finishedSegments={222}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@65015503[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 142 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 142 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 18 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=43, rsp_expected=true, UNICAST3: DATA, seqno=23, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 19 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #23, conn_id=1) 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 --> DATA(test-NodeB-18592: #24, conn_id=1) 14:54:29,084 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Starting outbound transfer to node test-NodeA-55522 for cache opt-cache, topology id 22, segments {159} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 20 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#23 14:54:29,084 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t6) Adding outbound transfer to test-NodeA-55522 for segments [159] 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received response for request 43 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 sending response for request 40 to test-NodeA-55522: SuccessfulResponse(null) 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447 --> DATA(test-NodeA-55522: #49, conn_id=0) 14:54:29,084 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t6) Invoked with command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@156cbb7f] 14:54:29,084 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeB-18592) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeB-18592, type=START_STATE_TRANSFER, topologyId=22, segments={134-135 174}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Removing inbound transfers from node {222} for segments test-NodeB-18592 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t6) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 144 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 144 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t2) Sending last chunk to node test-NodeA-55522 containing 0 cache entries from segments [159] 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 162 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} to recipient list [test-NodeA-55522] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=72 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 17 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #24, conn_id=1) 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 sending request 36 to test-NodeA-55522: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 --> DATA(test-NodeA-55522: #50, conn_id=0) 14:54:29,084 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Finished receiving of segments for cache opt-cache for topology 22. 14:54:29,084 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {134-135 174} 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#24 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=49, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t6) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, successful=true, topologyId=-1}, origin null 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #49, conn_id=0) 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received request 35 from test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#49 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={134-135 174}, finishedSegments={}, unfinishedSegments={134-135 174}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3db94d77[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t6) Setting command topology to 22 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 40 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,084 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} [sender=test-NodeD-25447] 14:54:29,084 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeA-55522) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeA-55522, type=START_STATE_TRANSFER, topologyId=22, segments={159}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,084 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (3 headers), size=52 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=50, TP: [cluster_name=ISPN] 14:54:29,084 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) Transaction.enlistResource(TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@12}) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013} 14:54:29,084 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {159} 14:54:29,084 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) XaResource.start() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 16 14:54:29,084 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (remote-thread-test-NodeC-p146-t6) start called on tx GlobalTx:test-NodeC-10992:18 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 180 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t6) Exists in context? null 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 166 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Waiting for inbound transfer to finish: InboundTransferTask{segments={159}, finishedSegments={}, unfinishedSegments={159}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@a5f0860[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeD-25447: #50, conn_id=0) 14:54:29,084 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-7,test-NodeB-18592) [Notifier] Checking command StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true}. 14:54:29,084 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,084 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeD-25447#50 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 163 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 166 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t6) Retrieved from container null 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received request 36 from test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 15 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 180 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 164 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 165 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 164 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 14 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 13 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 163 of cache ___defaultcache 14:54:29,084 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeD-p159-t4) Tracking is disabled. Clear tracker: {} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-7,test-NodeB-18592) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,084 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t6) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:29,084 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,084 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 12 14:54:29,084 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} [sender=test-NodeD-25447] 14:54:29,084 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeB-p138-t3) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,084 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-17,test-NodeA-55522) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Before applying the received state the data container of cache opt-cache has 2 keys 14:54:29,085 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,085 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeA-p130-t4) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Applying new state chunk for segment 134 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Applying new state chunk for segment 174 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Finished applying chunk of segment 134 of cache opt-cache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t4) Latch 2 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Applying new state chunk for segment 135 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Finished applying chunk of segment 174 of cache opt-cache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Before applying the received state the data container of cache opt-cache has 1 keys 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t3) Latch 1 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 197 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 189 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 197 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 181 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 11 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 198 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,084 TRACE [org.infinispan.container.EntryFactoryImpl] (remote-thread-test-NodeC-p146-t6) Updated context entry null -> VersionedRepeatableReadEntry(3711e334){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:29,084 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 198 of cache ___defaultcache 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447 --> DATA(test-NodeC-10992: #10, conn_id=2) 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 10 14:54:29,085 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeD-p159-t4) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 222 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished applying chunk of segment 135 of cache opt-cache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 222 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Applying new state chunk for segment 159 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 165 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 9 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeD-p159-t4) Latch 0 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) After applying the received state the data container of cache opt-cache has 1 keys 14:54:29,085 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeD-p154-t5) Segments not received yet for cache opt-cache: {} 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #10, conn_id=2) 14:54:29,085 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished receiving state for segments {134-135 174} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 189 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 225 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 181 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t6) Invoking: PutKeyValueCommand 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 225 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Inbound transfer finished: InboundTransferTask{segments={134-135 174}, finishedSegments={134-135 174}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@3db94d77[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,085 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-thread-test-NodeC-p146-t6) The return value is null 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 7 14:54:29,085 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 44 to test-NodeB-18592: null 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 8 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeB-18592: #25, conn_id=1) 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished applying chunk of segment 159 of cache opt-cache 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#10 14:54:29,085 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeC-p146-t6) Release locks for keys=[]. owner=CommandInvocation:local:0 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Removing inbound transfers from node {134-135 174} for segments test-NodeD-25447 14:54:29,085 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Finished receiving of segments for cache opt-cache for topology 22. 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,085 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t2) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 5 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 6 14:54:29,085 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeB-p143-t2) Tracking is disabled. Clear tracker: {} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 246 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,085 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeC-p146-t6) Clearing locked keys: [] 14:54:29,085 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,085 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished receiving state for segments {159} 14:54:29,085 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeD-25447] 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 248 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Inbound transfer finished: InboundTransferTask{segments={159}, finishedSegments={159}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@a5f0860[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,085 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Removing inbound transfers from node {159} for segments test-NodeD-25447 14:54:29,085 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Finished receiving of segments for cache opt-cache for topology 22. 14:54:29,085 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 22 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 246 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 226 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 4 14:54:29,085 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 22 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Applying new state chunk for segment 249 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Finished applying chunk of segment 249 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Rebalance confirmation collector 22@opt-cache received confirmation for test-NodeD-25447, remaining list is [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:29,085 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=44, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 226 of cache ___defaultcache 14:54:29,085 TRACE [org.infinispan.transaction.impl.LocalTransaction] (remote-thread-test-NodeC-p146-t6) Adding modification PutKeyValueCommand{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, successful=true, topologyId=22}. Mod list is null 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 2 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeD-25447: #25, conn_id=1) 14:54:29,085 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Latch 3 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592 --> DATA(test-NodeC-10992: #24, conn_id=1) 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 253 of cache ___defaultcache from node test-NodeB-18592: received 0 cache entries 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 253 of cache ___defaultcache 14:54:29,085 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeB-p143-t2) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeB-p143-t2) Latch 0 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) After applying the received state the data container of cache opt-cache has 2 keys 14:54:29,085 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,085 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeA-p135-t3) Tracking is disabled. Clear tracker: {} 14:54:29,085 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) Transaction.commit() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013} 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeD-25447#25 14:54:29,085 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) runPrepare() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013} 14:54:29,085 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 248 of cache ___defaultcache 14:54:29,085 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=24, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,085 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished receiving state for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeB-p138-t3) Segments not received yet for cache opt-cache: {} 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 1 14:54:29,085 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 sending response for request 35 to test-NodeD-25447: null 14:54:29,085 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) XAResource.end() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@12} 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592 --> DATA(test-NodeD-25447: #25, conn_id=2) 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522 --> DATA(test-NodeC-10992: #28, conn_id=1) 14:54:29,086 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (remote-thread-test-NodeC-p146-t6) end called on tx GlobalTx:test-NodeC-10992:18(opt-cache) 14:54:29,085 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 44 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeB-p138-t3) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) XaResource.prepare() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@12} 14:54:29,086 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,085 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #24, conn_id=1) 14:54:29,085 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Inbound transfer finished: InboundTransferTask{segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, finishedSegments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@2b40d73[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Removing inbound transfers from node {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} for segments test-NodeB-18592 14:54:29,086 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t2) Completed outbound transfer to node test-NodeD-25447, segments [222] 14:54:29,086 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t2) Removing completed outbound transfer of segments to test-NodeD-25447 for cache opt-cache, segments [222] 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeA-p135-t3) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=35, rsp_expected=true, UNICAST3: DATA, seqno=25, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeB-18592: #25, conn_id=2) 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeB-18592#25 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#24 14:54:29,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 0 14:54:29,086 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (remote-thread-test-NodeC-p146-t6) Sending prepare command through the chain: VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:18, cacheName='opt-cache'} 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received response for request 35 from test-NodeB-18592: SuccessfulResponse(null) 14:54:29,086 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t1) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t4) Segments not received yet for cache ___defaultcache: {test-NodeD-25447=[InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={}, unfinishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@75434430[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache}]} 14:54:29,086 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-15,test-NodeD-25447) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=134, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=135, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} is {test-NodeB-18592=SuccessfulResponse(null)} 14:54:29,086 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeB-18592] 14:54:29,086 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t1) Completed outbound transfer to node test-NodeB-18592, segments [134, 135, 174] 14:54:29,086 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,086 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t1) Removing completed outbound transfer of segments to test-NodeB-18592 for cache opt-cache, segments [134, 135, 174] 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992 sending response for request 40 to test-NodeB-18592: null 14:54:29,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeA-p135-t3) Latch 0 14:54:29,086 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992 invoking StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992 --> DATA(test-NodeB-18592: #20, conn_id=1) 14:54:29,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) After applying the received state the data container of cache opt-cache has 1 keys 14:54:29,086 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t6) Invoked with command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:18, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@13e0e53b] 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992 sending request 29 to test-NodeD-25447: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t4) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,086 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 22 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #28, conn_id=1) 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992 --> DATA(test-NodeD-25447: #8, conn_id=2) 14:54:29,086 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 22 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t1) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Rebalance confirmation collector 22@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeA-55522, test-NodeC-10992] 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=40, rsp_expected=true, UNICAST3: DATA, seqno=20, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #20, conn_id=1) 14:54:29,086 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t6) handleTxCommand for command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:18, cacheName='opt-cache'}, origin null 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#20 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 40 from test-NodeC-10992: SuccessfulResponse(null) 14:54:29,086 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=107, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:29,086 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeA-p130-t4) Segments not received yet for cache opt-cache: {} 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=239 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=8, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 sending response for request 36 to test-NodeD-25447: null 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #8, conn_id=2) 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522 --> DATA(test-NodeD-25447: #36, conn_id=2) 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#8 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#28 14:54:29,086 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t6) Setting command topology to 22 14:54:29,086 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t3) Completed outbound transfer to node test-NodeC-10992, segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeA-p130-t4) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received request 29 from test-NodeC-10992: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,086 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} [sender=test-NodeC-10992] 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,086 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t3) Removing completed outbound transfer of segments to test-NodeC-10992 for cache ___defaultcache, segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,086 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=22, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeA-55522] 14:54:29,086 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,086 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,086 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 22 14:54:29,086 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=36, rsp_expected=true, UNICAST3: DATA, seqno=36, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,086 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t6) Invoking: VersionedPrepareCommand 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeA-55522: #36, conn_id=2) 14:54:29,086 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeA-55522#36 14:54:29,086 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 22 14:54:29,086 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) runCommit(forceRollback=false) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013} 14:54:29,086 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,086 TRACE [org.infinispan.commons.tx.TransactionImpl] (remote-thread-test-NodeC-p146-t6) XaResource.commit() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@12} 14:54:29,086 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (remote-thread-test-NodeC-p146-t6) Committing transaction GlobalTx:test-NodeC-10992:18 14:54:29,086 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (remote-thread-test-NodeC-p146-t6) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:18, cacheName='opt-cache', topologyId=-1, updatedVersions=null} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6165aaba] 14:54:29,086 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t6) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:18, cacheName='opt-cache', topologyId=-1, updatedVersions=null}, origin null 14:54:29,087 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (remote-thread-test-NodeC-p146-t6) Setting command topology to 22 14:54:29,087 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (remote-thread-test-NodeC-p146-t6) Invoking: VersionedCommitCommand 14:54:29,087 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (remote-thread-test-NodeC-p146-t6) About to commit entry VersionedRepeatableReadEntry(3711e334){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,087 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeC-p146-t6) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=PUT_FOR_STATE_TRANSFER, L1 invalidation=false 14:54:29,087 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeC-p146-t6) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, new value=final-value 14:54:29,087 TRACE [org.infinispan.container.DefaultDataContainer] (remote-thread-test-NodeC-p146-t6) Store MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} in container 14:54:29,087 TRACE [org.infinispan.statetransfer.CommitManager] (remote-thread-test-NodeC-p146-t6) Committed key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 14:54:29,087 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (remote-thread-test-NodeC-p146-t6) Can release resources for transaction GlobalTx:test-NodeC-10992:18? true. Transaction info=null 14:54:29,087 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (remote-thread-test-NodeC-p146-t6) Release locks for keys=[]. owner=GlobalTx:test-NodeC-10992:18 14:54:29,087 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeC-p146-t6) Clearing locked keys: [] 14:54:29,087 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t6) Removed LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000013,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000013}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@12 from transaction table. 14:54:29,087 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (remote-thread-test-NodeC-p146-t6) Transaction GlobalTx:test-NodeC-10992:18 has completed, notifying listening threads. 14:54:29,087 TRACE [org.infinispan.transaction.impl.TransactionTable] (remote-thread-test-NodeC-p146-t6) Committed in onePhase? false isOptimistic? true 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 107 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 41 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 28 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 6 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,086 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t5) Starting outbound transfer to node test-NodeC-10992 for cache ___defaultcache, topology id 22, segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 19 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 28 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 7 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,086 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Rebalance confirmation collector 22@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeC-10992] 14:54:29,086 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 36 from test-NodeA-55522: SuccessfulResponse(null) 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 7 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t5) Adding outbound transfer to test-NodeC-10992 for segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 40 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 29 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 29 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 38 14:54:29,087 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t4) Sending last chunk to node test-NodeC-10992 containing 0 cache entries from segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,087 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 invoking StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,087 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 sending request 37 to test-NodeC-10992: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,087 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447 --> DATA(test-NodeC-10992: #11, conn_id=2) 14:54:29,087 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t4) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 19 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 6 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 37 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 30 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,087 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 29 to test-NodeC-10992: SuccessfulResponse(null) 14:54:29,087 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=159, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} is {test-NodeA-55522=SuccessfulResponse(null)} 14:54:29,087 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeC-10992: #12, conn_id=2) 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 39 14:54:29,087 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t2) Completed outbound transfer to node test-NodeA-55522, segments [159] 14:54:29,087 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,087 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=368 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 30 of cache opt-cache 14:54:29,087 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #11, conn_id=2) 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 36 14:54:29,087 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#11 14:54:29,087 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t2) Removing completed outbound transfer of segments to test-NodeA-55522 for cache opt-cache, segments [159] 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 35 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 41 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 32 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 41 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 31 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 31 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 32 of cache opt-cache 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 32 14:54:29,087 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=29, rsp_expected=true, UNICAST3: DATA, seqno=12, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,087 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received request 37 from test-NodeD-25447: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 33 14:54:29,087 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 34 14:54:29,088 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #12, conn_id=2) 14:54:29,088 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} [sender=test-NodeD-25447] 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 46 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 54 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 50 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#12 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 57 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 29 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 57 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 50 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 54 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-21,test-NodeC-10992) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 29 14:54:29,088 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,088 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeC-10992) Response(s) to StateRequestCommand{cache=___defaultcache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 30 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 31 14:54:29,088 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t1) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,088 TRACE [org.infinispan.remoting.inboundhandler.TrianglePerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 65 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 46 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 28 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 65 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Waiting for inbound transfer to finish: InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={}, unfinishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@75434430[Not completed], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 59 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 27 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Before applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 66 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 83 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 59 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 81 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 26 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 66 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 80 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 25 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 83 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 5 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 81 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 23 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 80 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 5 of cache ___defaultcache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 22 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 24 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 31 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 89 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 137 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 109 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 15 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 89 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 142 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 21 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 144 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 144 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 15 of cache ___defaultcache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 20 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 109 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 163 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 162 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 137 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 162 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 163 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 19 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 142 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 17 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 18 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 165 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 164 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 164 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 165 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 16 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 13 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 30 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 180 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 16 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 180 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 16 of cache ___defaultcache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 12 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 14 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 181 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 15 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 181 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 11 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 29 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 198 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 197 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 198 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 166 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 10 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 197 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 222 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 9 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 36 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 189 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 189 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 36 of cache ___defaultcache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 8 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 222 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 7 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 166 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 6 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 248 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 246 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 246 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 28 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 248 of cache opt-cache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 44 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 226 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 44 of cache ___defaultcache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 225 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 27 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 42 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 76 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 4 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 5 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 76 of cache ___defaultcache 14:54:29,088 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 226 of cache opt-cache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 3 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 42 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 225 of cache opt-cache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 26 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 249 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 92 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 2 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 25 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 92 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 90 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 85 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 249 of cache opt-cache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 85 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 90 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 24 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 22 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 23 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 1 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 97 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 99 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 98 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Applying new state chunk for segment 253 of cache opt-cache from node test-NodeB-18592: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 98 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 101 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 21 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 99 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 100 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 97 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 20 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 19 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Finished applying chunk of segment 253 of cache opt-cache 14:54:29,089 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (remote-thread-test-NodeC-p146-t6) Finished receiving state for segments {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 101 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 18 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 110 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 124 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 124 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 17 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 100 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 131 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 110 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 139 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 15 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 139 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 131 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 14 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 16 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 145 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 145 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 13 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 12 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 141 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 174 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Inbound transfer finished: InboundTransferTask{segments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, finishedSegments={6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253}, unfinishedSegments={}, source=test-NodeB-18592, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@7a6102c7[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 140 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 174 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 140 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Removing inbound transfers from node {6-7 19 28-32 41 46 50 54 57 59 65-66 80-81 83 89 107 109 137 142 144 162-166 180-181 189 197-198 222 225-226 246 248-249 253} for segments test-NodeB-18592 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 146 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 146 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 11 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 10 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Latch 0 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) After applying the received state the data container of cache opt-cache has 1 keys 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 9 14:54:29,089 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Requesting state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 183 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 178 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 178 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 8 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 141 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 invoking StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} to recipient list [test-NodeD-25447] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS_IGNORE_LEAVERS} 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 7 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 183 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t6) Segments not received yet for cache opt-cache: {test-NodeD-25447=[InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={}, unfinishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@447c1538[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache}]} 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 6 14:54:29,089 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 sending response for request 42 to test-NodeB-18592: null 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 217 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 230 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 217 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 sending request 30 to test-NodeD-25447: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 184 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 5 14:54:29,089 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 --> DATA(test-NodeB-18592: #21, conn_id=1) 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 229 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 184 of cache ___defaultcache 14:54:29,089 TRACE [org.jgroups.protocols.UNICAST3] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992 --> DATA(test-NodeD-25447: #9, conn_id=2) 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 4 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 229 of cache ___defaultcache 14:54:29,089 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 230 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 3 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 2 14:54:29,089 TRACE [org.jgroups.protocols.TCP_NIO2] (stateTransferExecutor-thread-test-NodeC-p151-t4) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 245 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 245 of cache ___defaultcache 14:54:29,089 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 1 14:54:29,089 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeA-55522: #36) 14:54:29,089 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeA-55522, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=36, conn_id=2, ts=11, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeB-18592: #25) 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=42, rsp_expected=true, UNICAST3: DATA, seqno=21, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeB-18592, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=25, conn_id=2, ts=12, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592 <-- DATA(test-NodeC-10992: #21, conn_id=1) 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#21 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=36, conn_id=2, ts=11, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeC-10992: #8) 14:54:29,090 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received response for request 42 from test-NodeC-10992: SuccessfulResponse(null) 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=8, conn_id=2, ts=13, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=25, conn_id=2, ts=12, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeD-25447: #25, conn-id=2, ts=12) 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 250 of cache ___defaultcache from node test-NodeD-25447: received 0 cache entries 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=8, conn_id=2, ts=13, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeD-25447: #36, conn-id=2, ts=11) 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 250 of cache ___defaultcache 14:54:29,090 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeB-18592) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=107, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=6, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=7, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=19, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=28, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=29, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=30, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=31, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=32, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=41, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=46, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=50, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=54, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=57, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=59, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=65, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=66, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=80, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=81, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=83, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=89, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=109, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=137, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=142, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=144, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=162, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=163, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=164, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=165, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=166, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=180, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=181, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=189, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=197, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=198, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=222, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=225, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=226, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=246, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=248, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=249, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=253, cacheEntries=0, isLastChunk=true}], origin=test-NodeB-18592, topologyId=22, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:29,090 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished receiving state for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeD-25447: #8, conn-id=2, ts=13) 14:54:29,090 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeB-p140-t5) Completed outbound transfer to node test-NodeC-10992, segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Inbound transfer finished: InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@75434430[Completed normally], topologyId=22, timeout=240000, cacheName=___defaultcache} 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Removing inbound transfers from node {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} for segments test-NodeD-25447 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=233 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=9, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,090 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeB-p140-t5) Removing completed outbound transfer of segments to test-NodeC-10992 for cache opt-cache, segments [6, 7, 19, 28, 29, 30, 31, 32, 41, 46, 50, 54, 57, 59, 65, 66, 80, 81, 83, 89, 107, 109, 137, 142, 144, 162, 163, 164, 165, 166, 180, 181, 189, 197, 198, 222, 225, 226, 246, 248, 249, 253] 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #9, conn_id=2) 14:54:29,090 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished receiving of segments for cache ___defaultcache for topology 22. 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#9 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,090 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,090 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t3) Tracking is disabled. Clear tracker: {} 14:54:29,090 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received request 30 from test-NodeC-10992: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,090 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute CacheRpcCommand: StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} [sender=test-NodeC-10992] 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 0 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) After applying the received state the data container of cache ___defaultcache has 0 keys 14:54:29,090 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,090 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,090 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeD-p154-t5) Calling perform() on StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} 14:54:29,090 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Segments not received yet for cache ___defaultcache: {} 14:54:29,090 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeC-10992, topology id = 22 14:54:29,090 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t5) Starting outbound transfer to node test-NodeC-10992 for cache opt-cache, topology id 22, segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,090 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 37 to test-NodeD-25447: null 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeD-25447: #10, conn_id=2) 14:54:29,090 TRACE [org.infinispan.statetransfer.StateProviderImpl] (remote-thread-test-NodeD-p154-t5) Adding outbound transfer to test-NodeC-10992 for segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,090 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,090 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) [Context=___defaultcache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 22 14:54:29,090 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 sending response for request 30 to test-NodeC-10992: SuccessfulResponse(null) 14:54:29,090 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t2) Rebalance confirmation collector 22@___defaultcache received confirmation for test-NodeC-10992, remaining list is [] 14:54:29,090 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447 --> DATA(test-NodeC-10992: #13, conn_id=2) 14:54:29,091 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) ISPN000336: Finished cluster-wide rebalance for cache ___defaultcache, topology id = 22 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeD-p154-t5) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t6) Sending last chunk to node test-NodeC-10992 containing 1 cache entries from segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,091 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 invoking StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} to recipient list [test-NodeC-10992] with options RpcOptions{timeout=240000, unit=MILLISECONDS, deliverOrder=NONE, responseFilter=null, responseMode=SYNCHRONOUS} 14:54:29,091 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Cache ___defaultcache topology updated: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=3 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=30, rsp_expected=true, UNICAST3: DATA, seqno=13, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #13, conn_id=2) 14:54:29,091 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#13 14:54:29,091 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received response for request 30 from test-NodeD-25447: SuccessfulResponse(null) 14:54:29,091 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-6,test-NodeC-10992) Response(s) to StateRequestCommand{cache=opt-cache, origin=test-NodeC-10992, type=START_STATE_TRANSFER, topologyId=22, segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}} is {test-NodeD-25447=SuccessfulResponse(null)} 14:54:29,091 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,091 TRACE [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Successfully requested state (START_STATE_TRANSFER) from node test-NodeD-25447 for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,091 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Waiting for inbound transfer to finish: InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={}, unfinishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@447c1538[Not completed], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,091 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,091 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t2) Initialized topology confirmation collector 23@___defaultcache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:29,091 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 sending request 38 to test-NodeC-10992: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,091 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447 --> DATA(test-NodeC-10992: #14, conn_id=2) 14:54:29,091 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t6) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=37, rsp_expected=true, UNICAST3: DATA, seqno=10, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #10, conn_id=2) 14:54:29,091 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#10 14:54:29,091 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,091 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 37 from test-NodeC-10992: SuccessfulResponse(null) 14:54:29,091 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateResponseCommand{cache=___defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=101, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (3 headers), size=570 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=14, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,091 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t4) Completed outbound transfer to node test-NodeC-10992, segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,091 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #14, conn_id=2) 14:54:29,091 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#14 14:54:29,091 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992: sending test-NodeC-10992#11 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 used 6568 credits, 1960256 remaining 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#11 14:54:29,091 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#11 14:54:29,091 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received request 38 from test-NodeD-25447: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,091 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,091 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute CacheRpcCommand: StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} [sender=test-NodeD-25447] 14:54:29,091 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,091 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,091 TRACE [org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest] (jgroups-6,test-NodeC-10992) [Blocking] Checking command StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true}. 14:54:29,091 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (jgroups-6,test-NodeC-10992) Checking if transaction data was received for topology 22, current topology is 22 14:54:29,091 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,091 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,091 TRACE [org.infinispan.remoting.inboundhandler.NonTotalOrderTxPerCacheInboundInvocationHandler] (remote-thread-test-NodeC-p146-t5) Calling perform() on StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} 14:54:29,091 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Before applying the received state the data container of cache opt-cache has 1 keys 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 36 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 16 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 16 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Applying new state chunk for segment 101 of cache opt-cache from node test-NodeD-25447: received 1 cache entries 14:54:29,091 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating local topology for cache ___defaultcache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 31 14:54:29,092 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 36 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 30 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 44 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 44 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 29 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 42 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 42 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 28 14:54:29,091 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 6568 credits, 1960267 remaining 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 14:54:29,091 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=11], TP: [cluster_name=ISPN] 14:54:29,092 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#11 14:54:29,092 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#11 14:54:29,091 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t4) Removing completed outbound transfer of segments to test-NodeC-10992 for cache ___defaultcache, segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,092 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#11 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 76 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 76 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 27 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 90 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 90 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 26 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 92 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 92 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 25 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 97 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 97 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 24 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 98 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 98 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 23 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 99 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 99 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 22 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 100 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 100 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 21 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 110 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 110 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 20 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 124 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 124 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 19 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 131 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 131 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 18 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 139 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 139 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 17 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 140 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 140 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 16 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 141 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 141 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 15 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 145 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 145 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 14 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 146 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 146 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 13 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 174 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 174 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 12 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 178 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 178 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 11 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 183 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 183 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 10 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 184 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 184 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 9 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 217 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 217 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 8 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 229 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 229 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 7 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 230 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 230 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 6 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 245 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 245 of cache opt-cache 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 5 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Applying new state chunk for segment 250 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Finished applying chunk of segment 250 of cache opt-cache 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Latch 4 14:54:29,092 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,092 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Applying new state chunk for segment 15 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Finished applying chunk of segment 15 of cache opt-cache 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t2) Latch 3 14:54:29,092 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeC-p151-t4) Created a new local transaction: LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=null} org.infinispan.transaction.xa.LocalXaTransaction@13 14:54:29,093 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t3) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,093 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Invoked with command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, successful=true, topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@c98393] 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) handleTxWriteCommand for command PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, successful=true, topologyId=-1}, origin null 14:54:29,093 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Setting command topology to 22 14:54:29,093 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t3) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling topology 23 is installed 14:54:29,093 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Transaction.enlistResource(TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=null} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@13}) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,092 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Applying new state chunk for segment 5 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,093 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) XaResource.start() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014} 14:54:29,093 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,092 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Applying new state chunk for segment 85 of cache opt-cache from node test-NodeD-25447: received 0 cache entries 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Finished applying chunk of segment 85 of cache opt-cache 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t1) Latch 2 14:54:29,093 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,092 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#11 14:54:29,093 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,093 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,093 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (stateTransferExecutor-thread-test-NodeC-p151-t4) start called on tx GlobalTx:test-NodeC-10992:19 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,093 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t3) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,093 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Exists in context? null 14:54:29,093 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t3) Tracking is disabled. Clear tracker: {} 14:54:29,093 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Retrieved from container null 14:54:29,093 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,093 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:29,093 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,093 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,093 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeC-10992 used 6568 credits, 1960256 remaining 14:54:29,093 TRACE [org.infinispan.container.EntryFactoryImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Updated context entry null -> VersionedRepeatableReadEntry(45cb0dee){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=null, isCreated=true, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedMetadata{version=SimpleClusteredVersion{topologyId=0, version=0}}} 14:54:29,093 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@7fb96ae2 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,093 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Invoking: PutKeyValueCommand 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Finished applying chunk of segment 5 of cache opt-cache 14:54:29,093 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache ___defaultcache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,093 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) The return value is null 14:54:29,093 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,093 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Release locks for keys=[]. owner=CommandInvocation:local:0 14:54:29,093 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeD-25447) test-NodeC-10992 used 6568 credits, 1960256 remaining 14:54:29,093 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeC-p151-t4) Clearing locked keys: [] 14:54:29,093 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t1) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,093 TRACE [org.infinispan.transaction.impl.LocalTransaction] (stateTransferExecutor-thread-test-NodeC-p151-t4) Adding modification PutKeyValueCommand{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], commandInvocationId=, putIfAbsent=false, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, successful=true, topologyId=22}. Mod list is null 14:54:29,093 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,093 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Transaction.commit() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,093 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t3) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,093 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t3) No change listeners present! 14:54:29,093 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,093 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t1) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling topology 23 is installed 14:54:29,093 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t3) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@30979069 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t3) Unlock State Transfer in Progress for topology ID 23 14:54:29,093 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t3) Signalling transaction data received for topology 23 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache ___defaultcache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,094 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,094 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522 --> DATA(test-NodeC-10992: #29, conn_id=1) 14:54:29,094 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t3) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,094 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,094 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t3) On stable topology update. Pending txs: 0 14:54:29,094 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=29, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,093 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t3) Latch 1 14:54:29,094 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #29, conn_id=1) 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,094 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#29 14:54:29,093 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t5) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,094 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,093 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) runPrepare() invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014} 14:54:29,093 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,094 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,094 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeA-55522] 14:54:29,094 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) XAResource.end() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@13} 14:54:29,094 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,094 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,094 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Tracking is disabled. Clear tracker: {} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t5) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,094 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,094 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeA-55522, topology id = 23 14:54:29,094 TRACE [org.infinispan.transaction.xa.XaTransactionTable] (stateTransferExecutor-thread-test-NodeC-p151-t4) end called on tx GlobalTx:test-NodeC-10992:19(opt-cache) 14:54:29,094 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t5) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling topology 23 is installed 14:54:29,094 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) XaResource.prepare() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@13} 14:54:29,094 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) [Context=___defaultcache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 23 14:54:29,094 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t6) Rebalance confirmation collector 23@___defaultcache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:29,094 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-thread-test-NodeC-p151-t4) Sending prepare command through the chain: VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:19, cacheName='opt-cache'} 14:54:29,094 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@39beb855 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,094 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,094 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Invoked with command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:19, cacheName='opt-cache'} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@40b88344] 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 23 is installed 14:54:29,094 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t1) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,094 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) handleTxCommand for command VersionedPrepareCommand {modifications=null, onePhaseCommit=false, retried=false, versionsSeen=null, gtx=GlobalTx:test-NodeC-10992:19, cacheName='opt-cache'}, origin null 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,094 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t5) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,094 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t5) Tracking is disabled. Clear tracker: {} 14:54:29,094 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@5d629bac passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,094 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t5) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,094 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t5) No change listeners present! 14:54:29,095 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@39404c3d passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,095 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Unlock State Transfer in Progress for topology ID 23 14:54:29,095 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling transaction data received for topology 23 14:54:29,095 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,095 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447 --> DATA(test-NodeC-10992: #15, conn_id=2) 14:54:29,095 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t5) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,095 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=15, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,094 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t1) No change listeners present! 14:54:29,095 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #15, conn_id=2) 14:54:29,095 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,095 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,095 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@24143e39 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,094 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Setting command topology to 22 14:54:29,095 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Unlock State Transfer in Progress for topology ID 23 14:54:29,095 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,095 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling transaction data received for topology 23 14:54:29,095 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) On stable topology update. Pending txs: 0 14:54:29,095 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#15 14:54:29,095 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Invoking: VersionedPrepareCommand 14:54:29,095 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,095 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeD-25447] 14:54:29,095 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,095 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeD-25447, topology id = 23 14:54:29,095 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,095 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t6) Tracking is disabled. Clear tracker: {} 14:54:29,095 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) [Context=___defaultcache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 23 14:54:29,095 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t6) Rebalance confirmation collector 23@___defaultcache received confirmation for test-NodeD-25447, remaining list is [test-NodeB-18592, test-NodeC-10992] 14:54:29,095 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@46b0a97f passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,095 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t6) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,095 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t6) No change listeners present! 14:54:29,095 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@69b2f2d1 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache '___defaultcache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,095 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Unlock State Transfer in Progress for topology ID 23 14:54:29,095 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 23 14:54:29,095 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,095 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592 --> DATA(test-NodeC-10992: #25, conn_id=1) 14:54:29,095 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t6) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,095 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=25, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,095 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,096 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) On stable topology update. Pending txs: 0 14:54:29,095 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,095 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) runCommit(forceRollback=false) invoked in transaction with Xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014} 14:54:29,096 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) On stable topology update. Pending txs: 0 14:54:29,095 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,095 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #25, conn_id=1) 14:54:29,096 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeC-10992, topology id = 23 14:54:29,096 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#25 14:54:29,096 TRACE [org.infinispan.commons.tx.TransactionImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) XaResource.commit() for TransactionXaAdapter{localTransaction=LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@13} 14:54:29,096 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,096 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t6) [Context=___defaultcache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 23 14:54:29,096 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeB-18592] 14:54:29,096 TRACE [org.infinispan.transaction.impl.TransactionCoordinator] (stateTransferExecutor-thread-test-NodeC-p151-t4) Committing transaction GlobalTx:test-NodeC-10992:19 14:54:29,096 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,096 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t6) Rebalance confirmation collector 23@___defaultcache received confirmation for test-NodeC-10992, remaining list is [test-NodeB-18592] 14:54:29,096 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeB-18592, topology id = 23 14:54:29,096 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Invoked with command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:19, cacheName='opt-cache', topologyId=-1, updatedVersions=null} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@74c4ec29] 14:54:29,096 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) [Context=___defaultcache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 23 14:54:29,096 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) handleTxCommand for command VersionedCommitCommand{gtx=GlobalTx:test-NodeC-10992:19, cacheName='opt-cache', topologyId=-1, updatedVersions=null}, origin null 14:54:29,096 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t6) Rebalance confirmation collector 23@___defaultcache received confirmation for test-NodeB-18592, remaining list is [] 14:54:29,096 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Setting command topology to 22 14:54:29,096 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) Invoking: VersionedCommitCommand 14:54:29,096 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeC-p146-t6) Cache ___defaultcache topology updated: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,096 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (stateTransferExecutor-thread-test-NodeC-p151-t4) About to commit entry VersionedRepeatableReadEntry(45cb0dee){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=true, isChanged=true, isRemoved=false, isExpired=false, skipLookup=true, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,096 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeC-p146-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,096 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=PUT_FOR_STATE_TRANSFER, L1 invalidation=false 14:54:29,096 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeC-p146-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,096 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-thread-test-NodeC-p151-t4) Creating new ICE for writing. Existing=null, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}, new value=final-value 14:54:29,096 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t6) Initialized topology confirmation collector 24@___defaultcache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:29,096 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeC-p146-t6) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,096 TRACE [org.infinispan.container.DefaultDataContainer] (stateTransferExecutor-thread-test-NodeC-p151-t4) Store MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} in container 14:54:29,096 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Committed key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Old discard policy=null. New discard policy=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false} 14:54:29,096 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Can release resources for transaction GlobalTx:test-NodeC-10992:19? true. Transaction info=null 14:54:29,096 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,096 TRACE [org.infinispan.util.concurrent.locks.impl.DefaultLockManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Release locks for keys=[]. owner=GlobalTx:test-NodeC-10992:19 14:54:29,096 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeC-p151-t4) Clearing locked keys: [] 14:54:29,096 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,096 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992: sending test-NodeC-10992#12 14:54:29,096 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,096 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 14:54:29,096 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeC-p151-t4) Removed LocalXaTransaction{xid=Xid{formatId=1, globalTransactionId=A3D124C85FD8DB45465BCF185BBA403D0000000000000014,branchQualifier=A3D124C85FD8DB45465BCF185BBA403D0000000000000014}} LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=[], backupKeyLocks=[], topologyId=22, stateTransferFlag=PUT_FOR_STATE_TRANSFER} org.infinispan.transaction.xa.LocalXaTransaction@13 from transaction table. 14:54:29,096 TRACE [org.infinispan.transaction.impl.AbstractCacheTransaction] (stateTransferExecutor-thread-test-NodeC-p151-t4) Transaction GlobalTx:test-NodeC-10992:19 has completed, notifying listening threads. 14:54:29,096 TRACE [org.infinispan.transaction.impl.TransactionTable] (stateTransferExecutor-thread-test-NodeC-p151-t4) Committed in onePhase? false isOptimistic? true 14:54:29,096 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished applying chunk of segment 101 of cache opt-cache 14:54:29,096 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,096 DEBUG [org.infinispan.statetransfer.InboundTransferTask] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished receiving state for segments {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} 14:54:29,096 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 14:54:29,096 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#12 14:54:29,096 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 14:54:29,096 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Inbound transfer finished: InboundTransferTask{segments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, finishedSegments={5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250}, unfinishedSegments={}, source=test-NodeD-25447, isCancelled=false, completionFuture=java.util.concurrent.CompletableFuture@447c1538[Completed normally], topologyId=22, timeout=240000, cacheName=opt-cache} 14:54:29,096 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#12 14:54:29,096 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#12 14:54:29,096 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,096 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Removing inbound transfers from node {5 15-16 36 42 44 76 85 90 92 97-101 110 124 131 139-141 145-146 174 178 183-184 217 229-230 245 250} for segments test-NodeD-25447 14:54:29,096 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#12 14:54:29,096 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Finished receiving of segments for cache opt-cache for topology 22. 14:54:29,096 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,096 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,096 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,096 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,096 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,096 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,096 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,096 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 6568 credits, 1953699 remaining 14:54:29,096 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t3) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,096 TRACE [org.infinispan.statetransfer.CommitManager] (stateTransferExecutor-thread-test-NodeC-p151-t4) Tracking is disabled. Clear tracker: {MagicKey#k1{8/537A1109/107@test-NodeB-18592}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}, MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}=DiscardPolicy{discardStateTransfer=true, discardXSiteStateTransfer=false}} 14:54:29,096 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,096 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,096 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t5) Updating local topology for cache ___defaultcache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,096 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (stateTransferExecutor-thread-test-NodeC-p151-t4) Latch 0 14:54:29,096 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,096 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeC-10992 used 6568 credits, 1953688 remaining 14:54:29,097 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=22, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,097 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t4) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 22 14:54:29,097 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t3) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t3) Signalling topology 24 is installed 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) On cache ___defaultcache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,097 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t1) Updating local topology for cache ___defaultcache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t3) Signalling transaction data received for topology 24 14:54:29,097 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,097 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t3) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t3) On stable topology update. Pending txs: 0 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,097 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=12], TP: [cluster_name=ISPN] 14:54:29,097 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#12 14:54:29,097 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#12 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t1) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,097 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) After applying the received state the data container of cache opt-cache has 2 keys 14:54:29,097 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,097 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeC-p146-t6) test-NodeC-10992 used 6568 credits, 1953688 remaining 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (remote-thread-test-NodeC-p146-t5) Segments not received yet for cache opt-cache: {} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeC-10992, topology id = 24 14:54:29,097 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t3) Updating local topology for cache ___defaultcache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) [Context=___defaultcache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 24 14:54:29,097 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t1) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling topology 24 is installed 14:54:29,097 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t4) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 22 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t5) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache ___defaultcache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,097 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t2) Rebalance confirmation collector 24@___defaultcache received confirmation for test-NodeC-10992, remaining list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447] 14:54:29,097 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 38 to test-NodeD-25447: null 14:54:29,097 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,097 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeD-25447: #11, conn_id=2) 14:54:29,097 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t5) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,097 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t4) Rebalance confirmation collector 22@opt-cache received confirmation for test-NodeC-10992, remaining list is [] 14:54:29,097 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,097 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t4) ISPN000336: Finished cluster-wide rebalance for cache opt-cache, topology id = 22 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,097 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeD-25447) test-NodeC-10992 used 6568 credits, 1953688 remaining 14:54:29,097 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t5) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,097 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t4) Cache opt-cache topology updated: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,097 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (3 headers), size=1 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=38, rsp_expected=true, UNICAST3: DATA, seqno=11, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,097 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447 <-- DATA(test-NodeC-10992: #11, conn_id=2) 14:54:29,097 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#11 14:54:29,097 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,098 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received response for request 38 from test-NodeC-10992: SuccessfulResponse(null) 14:54:29,098 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,098 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t4) Initialized topology confirmation collector 23@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:29,098 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,098 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,098 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,098 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending test-NodeC-10992#13 14:54:29,098 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 14:54:29,098 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating local topology for cache opt-cache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,098 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t4) test-NodeC-10992 used 6562 credits, 1947126 remaining 14:54:29,098 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t3) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,098 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 14:54:29,098 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#13 14:54:29,098 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#13 14:54:29,098 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,098 TRACE [org.infinispan.remoting.rpc.RpcManagerImpl] (jgroups-7,test-NodeD-25447) Response(s) to StateResponseCommand{cache=opt-cache, pushTransfer=false, stateChunks=[StateChunk{segmentId=101, cacheEntries=1, isLastChunk=true}, StateChunk{segmentId=5, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=15, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=16, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=36, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=42, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=44, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=76, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=85, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=90, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=92, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=97, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=98, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=99, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=100, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=110, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=124, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=131, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=139, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=140, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=141, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=145, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=146, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=174, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=178, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=183, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=184, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=217, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=229, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=230, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=245, cacheEntries=0, isLastChunk=true}, StateChunk{segmentId=250, cacheEntries=0, isLastChunk=true}], origin=test-NodeD-25447, topologyId=22, applyState=true} is {test-NodeC-10992=SuccessfulResponse(null)} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling topology 24 is installed 14:54:29,098 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,098 TRACE [org.infinispan.statetransfer.OutboundTransferTask] (transport-thread-test-NodeD-p156-t6) Completed outbound transfer to node test-NodeC-10992, segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,098 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,098 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,098 TRACE [org.infinispan.statetransfer.StateProviderImpl] (transport-thread-test-NodeD-p156-t6) Removing completed outbound transfer of segments to test-NodeC-10992 for cache opt-cache, segments [5, 15, 16, 36, 42, 44, 76, 85, 90, 92, 97, 98, 99, 100, 101, 110, 124, 131, 139, 140, 141, 145, 146, 174, 178, 183, 184, 217, 229, 230, 245, 250] 14:54:29,098 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,098 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,098 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t5) Signalling transaction data received for topology 24 14:54:29,098 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,098 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522 --> DATA(test-NodeC-10992: #30, conn_id=1) 14:54:29,098 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t5) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,098 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=30, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,098 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #30, conn_id=1) 14:54:29,098 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#30 14:54:29,098 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,097 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,098 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,098 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 14:54:29,098 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t1) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,098 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#13 14:54:29,098 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,098 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,098 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeC-10992 used 6562 credits, 1947126 remaining 14:54:29,098 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,098 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=13], TP: [cluster_name=ISPN] 14:54:29,098 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,098 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t4) Updating local topology for cache opt-cache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,098 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#13 14:54:29,098 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#13 14:54:29,099 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t3) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,098 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#13 14:54:29,098 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t5) On stable topology update. Pending txs: 0 14:54:29,098 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t1) Signalling transaction data received for topology 24 14:54:29,098 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeA-55522] 14:54:29,099 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,099 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,099 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeA-55522, topology id = 24 14:54:29,099 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,099 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,099 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,099 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) [Context=___defaultcache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 24 14:54:29,099 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Rebalance confirmation collector 24@___defaultcache received confirmation for test-NodeA-55522, remaining list is [test-NodeB-18592, test-NodeD-25447] 14:54:29,099 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t1) Updating local topology for cache opt-cache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,099 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t4) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,099 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,099 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,099 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,099 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,099 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,099 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t4) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling topology 23 is installed 14:54:29,099 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,099 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,099 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeB-p140-t4) Tracking is disabled. Clear tracker: {} 14:54:29,099 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@634a99a1 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,099 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,099 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeB-p140-t4) No change listeners present! 14:54:29,099 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@5d29ddfa passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t4) Unlock State Transfer in Progress for topology ID 23 14:54:29,099 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t4) Signalling transaction data received for topology 23 14:54:29,099 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,099 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,099 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,099 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592 --> DATA(test-NodeC-10992: #26, conn_id=1) 14:54:29,099 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t4) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,100 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,100 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=26, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,099 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,100 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #26, conn_id=1) 14:54:29,099 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling topology 24 is installed 14:54:29,099 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,100 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#26 14:54:29,100 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Topology changed, recalculating minTopologyId 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache ___defaultcache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:29,099 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t1) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,100 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,100 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,100 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t1) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling topology 23 is installed 14:54:29,100 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache opt-cache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,099 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeD-25447) test-NodeC-10992 used 6562 credits, 1947126 remaining 14:54:29,099 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,099 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,100 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592 --> DATA(test-NodeC-10992: #27, conn_id=1) 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,100 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t1) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling topology 23 is installed 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,100 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,100 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t1) Tracking is disabled. Clear tracker: {} 14:54:29,100 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@33b8274d passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,100 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t1) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,100 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeD-p156-t1) No change listeners present! 14:54:29,100 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@6342a1e4 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t1) Unlock State Transfer in Progress for topology ID 23 14:54:29,100 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t1) Signalling transaction data received for topology 23 14:54:29,100 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,100 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,100 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,100 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447 --> DATA(test-NodeC-10992: #16, conn_id=2) 14:54:29,100 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t1) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,101 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,101 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Topology changed, recalculating minTopologyId 14:54:29,101 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=16, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,100 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,100 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t4) Changing minimum topology ID from 22 to 23 14:54:29,100 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,101 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,101 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t3) Signalling transaction data received for topology 24 14:54:29,101 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,101 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeB-18592] 14:54:29,101 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #16, conn_id=2) 14:54:29,101 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#16 14:54:29,101 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t4) Updating local topology for cache opt-cache: CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,101 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t1) Changing minimum topology ID from 22 to 23 14:54:29,100 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,101 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 23 14:54:29,100 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t1) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,101 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,101 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t1) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t1) On stable topology update. Pending txs: 0 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) On stable topology update. Pending txs: 0 14:54:29,101 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeC-p148-t1) Tracking is disabled. Clear tracker: {} 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t4) On stable topology update. Pending txs: 0 14:54:29,101 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,101 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,101 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeD-25447] 14:54:29,101 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,101 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,101 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@37794112 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,101 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447 --> DATA(test-NodeC-10992: #17, conn_id=2) 14:54:29,101 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,101 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t3) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,101 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,101 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 6562 credits, 1947137 remaining 14:54:29,101 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=27, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,101 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #27, conn_id=1) 14:54:29,101 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#27 14:54:29,101 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,101 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeB-18592] 14:54:29,101 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,101 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 23 14:54:29,101 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t4) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeB-18592, topology id = 24 14:54:29,101 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=55 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=17, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,101 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #17, conn_id=2) 14:54:29,101 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t6) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 23 14:54:29,101 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t4) [Context=___defaultcache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 24 14:54:29,101 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 23 14:54:29,101 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#17 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,101 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,101 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeD-25447] 14:54:29,101 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,101 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t3) ISPN000328: Finished local rebalance for cache ___defaultcache on node test-NodeD-25447, topology id = 24 14:54:29,101 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t1) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,101 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeC-p148-t1) No change listeners present! 14:54:29,101 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@2eec5549 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,101 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Unlock State Transfer in Progress for topology ID 23 14:54:29,101 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling transaction data received for topology 23 14:54:29,101 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t4) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 159-160 168-169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 134-136 139-141 143 148 150 154 158-159 161 167 171 174-175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 58-59 62 71 75 78 83-84 87 89 91 96 104 108-109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 222-223 227-228 231-232 237-239 242 244 248-249 254-255} test-NodeC-10992 primary: {}, backup: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,101 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:29,101 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:29,101 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,102 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t4) Installing new cache topology CacheTopology{id=23, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,102 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,102 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 23 14:54:29,102 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,102 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t5) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 23 14:54:29,102 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,102 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,102 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t4) (isRunning=true) Installed new topology 23: CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,102 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling topology 23 is installed 14:54:29,102 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,102 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,102 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Topology update processed, stateTransferTopologyId = 22, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,102 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Stop keeping track of changed keys for state transfer in topology 22 14:54:29,102 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t4) Set track to PUT_FOR_STATE_TRANSFER = false 14:54:29,102 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t4) Tracking is disabled. Clear tracker: {} 14:54:29,102 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.stream.impl.LocalStreamManagerImpl@4b9c7f08 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,102 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t4) Data rehash occurred startHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]} and endHash: PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} with new topology 23 and was pre false 14:54:29,102 TRACE [org.infinispan.stream.impl.LocalStreamManagerImpl] (transport-thread-test-NodeA-p132-t4) No change listeners present! 14:54:29,102 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.conflict.impl.StateReceiverImpl@717e8b65 passing event EventImpl{type=DATA_REHASHED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, newTopologyId=23} 14:54:29,102 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t4) Unlock State Transfer in Progress for topology ID 23 14:54:29,102 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t4) Signalling transaction data received for topology 23 14:54:29,102 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,102 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,102 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=23, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,102 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522 --> DATA(test-NodeC-10992: #31, conn_id=1) 14:54:29,102 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t4) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,102 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,102 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Topology changed, recalculating minTopologyId 14:54:29,102 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t4) Changing minimum topology ID from 22 to 23 14:54:29,102 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,103 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t4) On stable topology update. Pending txs: 0 14:54:29,101 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t3) On stable topology update. Pending txs: 0 14:54:29,101 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t4) Rebalance confirmation collector 24@___defaultcache received confirmation for test-NodeB-18592, remaining list is [test-NodeD-25447] 14:54:29,101 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t6) Rebalance confirmation collector 23@opt-cache received confirmation for test-NodeD-25447, remaining list is [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992] 14:54:29,102 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=31, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,103 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t5) Rebalance confirmation collector 23@opt-cache received confirmation for test-NodeC-10992, remaining list is [test-NodeA-55522, test-NodeB-18592] 14:54:29,102 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,101 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t3) [Context=___defaultcache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 24 14:54:29,103 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Rebalance confirmation collector 23@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeA-55522] 14:54:29,103 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t3) Rebalance confirmation collector 24@___defaultcache received confirmation for test-NodeD-25447, remaining list is [] 14:54:29,103 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #31, conn_id=1) 14:54:29,103 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) Topology changed, recalculating minTopologyId 14:54:29,103 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#31 14:54:29,103 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t1) Minimum topology ID still is 15; nothing to change 14:54:29,103 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeC-p146-t3) Cache ___defaultcache topology updated: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [] 14:54:29,103 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,103 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=23, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeA-55522] 14:54:29,103 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,103 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, unionConsistentHash=null, newTopologyId=23} 14:54:29,103 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 23 14:54:29,103 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeC-p146-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,103 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 23 14:54:29,103 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Rebalance confirmation collector 23@opt-cache received confirmation for test-NodeA-55522, remaining list is [] 14:54:29,103 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeC-p146-t3) Updating cluster-wide current topology for cache ___defaultcache, topology = CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,103 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) Check if topology CacheTopology{id=23, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) On stable topology update. Pending txs: 0 14:54:29,103 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeC-p146-t5) Cache opt-cache topology updated: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [test-NodeC-10992] 14:54:29,103 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,103 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,103 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeC-p146-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,103 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992: sending test-NodeC-10992#14 14:54:29,103 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Updating local topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 14:54:29,103 TRACE [org.infinispan.topology.CacheTopology] (remote-thread-test-NodeC-p146-t5) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,103 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,103 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Initialized topology confirmation collector 24@opt-cache, initial list is [test-NodeA-55522, test-NodeB-18592, test-NodeD-25447, test-NodeC-10992] 14:54:29,103 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t1) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,103 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeC-p146-t5) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,103 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 used 3404 credits, 1943722 remaining 14:54:29,103 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3404 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 14:54:29,103 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t1) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#14 14:54:29,103 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling topology 25 is installed 14:54:29,103 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#14 14:54:29,103 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3404 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 14:54:29,103 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#14 14:54:29,103 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,103 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache ___defaultcache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,103 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) On cache ___defaultcache we have: added segments: {}; removed segments: {} 14:54:29,103 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,103 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,103 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t1) Signalling transaction data received for topology 25 14:54:29,103 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,103 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t1) Removing no longer owned entries for cache ___defaultcache 14:54:29,103 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Updating local topology for cache opt-cache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t1) On stable topology update. Pending txs: 0 14:54:29,103 TRACE [org.infinispan.topology.ClusterCacheStatus] (remote-thread-test-NodeC-p146-t3) Updating stable topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,103 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (remote-thread-test-NodeC-p146-t3) Updating cluster-wide stable topology for cache ___defaultcache, topology = CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,103 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 3404 credits, 1943733 remaining 14:54:29,103 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Attempting to execute command on self: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,103 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,103 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3404 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=14], TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Updating stable topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Updating local topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t5) On stable topology update. Pending txs: 0 14:54:29,103 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending test-NodeC-10992#15 14:54:29,103 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#14 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#14 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#14 14:54:29,104 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,104 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,104 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,104 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeC-10992 used 3404 credits, 1943722 remaining 14:54:29,104 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 used 6562 credits, 1937160 remaining 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992: sending test-NodeC-10992#16 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 14:54:29,104 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t2) Updating local topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,103 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#15 14:54:29,104 TRACE [org.jgroups.protocols.MFC] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 used 3402 credits, 1933758 remaining 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#15 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3402 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t2) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,104 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,104 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3402 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#16 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#15 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#16 14:54:29,104 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t2) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3402 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=16], TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,104 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,104 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,104 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,104 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,104 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeA-55522) test-NodeC-10992 used 3402 credits, 1940331 remaining 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#15 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t6) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,104 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t6) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,104 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,104 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,104 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,104 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeB-18592) test-NodeC-10992 used 6562 credits, 1937160 remaining 14:54:29,104 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#16 14:54:29,104 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling topology 25 is installed 14:54:29,104 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t3) Updating local topology for cache opt-cache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t2) Updating local topology for cache opt-cache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache ___defaultcache we have: new segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,104 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) On cache ___defaultcache we have: added segments: {}; removed segments: {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253} 14:54:29,104 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,104 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t2) Signalling transaction data received for topology 25 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,104 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t2) Removing no longer owned entries for cache ___defaultcache 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t2) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,105 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t2) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,105 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,105 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,105 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,105 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t2) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,105 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling topology 24 is installed 14:54:29,105 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache opt-cache we have: new segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:29,105 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,105 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,105 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t2) Signalling transaction data received for topology 24 14:54:29,105 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,105 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,105 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,105 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447 --> DATA(test-NodeC-10992: #18, conn_id=2) 14:54:29,105 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeD-p156-t2) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#16 14:54:29,104 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,105 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,105 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeD-25447) test-NodeC-10992 used 3404 credits, 1943722 remaining 14:54:29,104 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=15], TP: [cluster_name=ISPN] 14:54:29,105 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t2) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,105 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#15 14:54:29,105 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#15 14:54:29,105 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Updating local topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,105 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,105 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,105 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,105 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=18, conn_id=2, TP: [cluster_name=ISPN] 14:54:29,105 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Topology changed, recalculating minTopologyId 14:54:29,105 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#16 14:54:29,105 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t4) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache ___defaultcache 14:54:29,105 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,104 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,105 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,105 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t3) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,105 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t3) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,105 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,106 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t3) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling topology 24 is installed 14:54:29,106 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: new segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t3) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t3) Signalling transaction data received for topology 24 14:54:29,106 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,106 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,106 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,106 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592 --> DATA(test-NodeC-10992: #28, conn_id=1) 14:54:29,106 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeB-p140-t3) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,106 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,106 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Topology changed, recalculating minTopologyId 14:54:29,106 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t3) Changing minimum topology ID from 23 to 24 14:54:29,106 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t3) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,106 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t3) On stable topology update. Pending txs: 0 14:54:29,104 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#16 14:54:29,104 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,104 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,106 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=28, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,106 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,106 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeB-18592: #28, conn_id=1) 14:54:29,106 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeB-18592#28 14:54:29,106 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeB-18592: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,106 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeB-18592, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeB-18592] 14:54:29,106 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,106 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t3) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeB-18592, topology id = 24 14:54:29,105 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,105 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t2) On stable topology update. Pending txs: 0 14:54:29,105 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t2) Changing minimum topology ID from 23 to 24 14:54:29,106 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t3) [Context=opt-cache][Scope=test-NodeB-18592]ISPN100003: Node test-NodeB-18592 finished rebalance phase with topology id 24 14:54:29,105 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,105 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Received new topology for cache ___defaultcache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,106 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 6562 credits, 1933769 remaining 14:54:29,106 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t2) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling topology 25 is installed 14:54:29,106 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t1) Updating local topology for cache opt-cache: CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache ___defaultcache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) On cache ___defaultcache we have: added segments: {}; removed segments: {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247} 14:54:29,106 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,106 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t2) Signalling transaction data received for topology 25 14:54:29,107 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2-4 8-9 11 14 18 22 27 34-35 37 39-40 43 45 47-49 52 55-56 58 61 68 71 75 82 86 91 94-95 103 108 111-115 118-119 123 125 130 132 136 138 143 148 150 152-153 158 161 170 173 175 177 188 191-193 195-196 200-202 207 209 211 214 216 218 221 223 227-228 231-232 235 237-239 244 247 252 254-255}, backup: {1 6-7 10 13 17 21 26 33 36 38 42 44 46 50-51 54 57 60 65-67 69-70 74 80-81 85 90 93 102 107 110 116-117 121-122 124 129 131 134-135 137 142 145-147 149 151 156-157 160 169 172 174 176 187 189-190 194 199 203-206 208 210 213 215 217 220 222 225-226 229-230 233-234 236 243 246 251 253} test-NodeB-18592 primary: {6-7 13 17 19-20 23 25 28-32 41 46 50-51 54 57 59 62 65-67 69-70 74 78 80-81 83-84 87 89 93 96 102 104 107 109 120 128 133 137 142 144 149 151 155 160 162-166 168 172 176 180-182 185-186 189-190 194 197-198 208 212 215 219 222 225-226 236 242 246 248-249 251 253}, backup: {5 12 15-16 18 22 24 27 39-40 45 47-49 53 55-56 58 61 63-64 68 72-73 76-77 79 82 86 88 92 94-95 97-101 103 105-106 108 118-119 126-127 132 136 139-141 143 148 150 154 159 161 167 171 175 178-179 183-184 188 191-193 195-196 207 211 214 218 221 224 235 240-241 245 247 250 252} test-NodeD-25447 primary: {1 5 10 12 15-16 21 24 26 33 36 38 42 44 53 60 63-64 72-73 76-77 79 85 88 90 92 97-101 105-106 110 116-117 121-122 124 126-127 129 131 134-135 139-141 145-147 154 156-157 159 167 169 171 174 178-179 183-184 187 199 203-206 210 213 217 220 224 229-230 233-234 240-241 243 245 250}, backup: {0 2-4 8-9 11 14 19-20 23 25 28-32 34-35 37 41 43 52 59 62 71 75 78 83-84 87 89 91 96 104 109 111-115 120 123 125 128 130 133 138 144 152-153 155 158 162-166 168 170 173 177 180-182 185-186 197-198 200-202 209 212 216 219 223 227-228 231-232 237-239 242 244 248-249 254-255} 14:54:29,107 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t2) Removing no longer owned entries for cache ___defaultcache 14:54:29,107 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Pending consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,107 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,107 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) On stable topology update. Pending txs: 0 14:54:29,107 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t1) Union consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 36-38 40 42 44-46 48 50-51 54-55 57-58 60 65-67 69-70 74 80-81 85-86 90 93 102 107-108 110-111 114-117 121-122 124-125 129 131-132 134-137 142 145-147 149 151 156-157 159-160 168 172 174-176 187 189-190 193-194 196 199 203-206 208 210 213 215 217-218 220 222-223 225-227 229-230 233-234 236 243 246-247 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {5-7 12 15-16 18-19 22 24 27 29 32 39-40 45-50 53 55-56 58-59 61 63-64 66 68 72-73 76-77 79 81-83 86 88 92 94-95 97-101 103 105-106 108-109 118-119 126-127 132 134-135 137 139-144 148 150 154 158 161 166-167 171 174-175 178-179 181 183-184 188-189 191-193 195-196 198 207 211 214 218 221-222 224 235 240-241 245 247 250 252-253} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 2-4 8-9 11 14 16 19-20 23 25 28-32 34-35 37 41-43 52 58-59 62 71 75-76 78 83-84 87 89-92 96 98 101 104 108-109 111-115 120 123 125 128 130 133 138-139 144 146 152-153 155 158-159 162-166 168-170 173-174 177-178 180-182 184-186 197-198 200-202 209 212 216 219 222-223 227-228 230-232 237-239 242 244-245 248-250 254-255} 14:54:29,107 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t1) Installing new cache topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,107 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,107 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,107 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t1) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,107 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling topology 24 is installed 14:54:29,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t1) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,107 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t1) Signalling transaction data received for topology 24 14:54:29,107 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,107 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,107 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 sending command to test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,107 TRACE [org.jgroups.protocols.UNICAST3] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522 --> DATA(test-NodeC-10992: #32, conn_id=1) 14:54:29,107 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeA-p132-t1) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,107 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=49 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are UNICAST3: DATA, seqno=32, conn_id=1, TP: [cluster_name=ISPN] 14:54:29,106 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t3) Rebalance confirmation collector 24@opt-cache received confirmation for test-NodeB-18592, remaining list is [test-NodeA-55522, test-NodeD-25447, test-NodeC-10992] 14:54:29,106 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeD-25447: #18, conn_id=2) 14:54:29,106 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t4) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,106 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,106 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeD-25447) test-NodeC-10992 used 6562 credits, 1937160 remaining 14:54:29,107 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,107 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling topology 25 is installed 14:54:29,107 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeC-10992 used 3402 credits, 1933758 remaining 14:54:29,107 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeD-25447#18 14:54:29,107 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992 <-- DATA(test-NodeA-55522: #32, conn_id=1) 14:54:29,107 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,107 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeD-25447: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,107 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t2) Updating stable topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t2) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,108 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t5) Updating stable topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,106 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,108 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeC-10992 used 3402 credits, 1933758 remaining 14:54:29,107 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeD-25447, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeD-25447] 14:54:29,107 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Topology changed, recalculating minTopologyId 14:54:29,108 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t1) Changing minimum topology ID from 23 to 24 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t2) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t2) On stable topology update. Pending txs: 0 14:54:29,108 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t1) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,107 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#32 14:54:29,107 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,108 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeA-55522, joinInfo=null, topologyId=24, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} [sender=test-NodeA-55522] 14:54:29,108 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,108 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t6) (isRunning=true) Installed new topology 24: CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t3) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeD-25447, topology id = 24 14:54:29,108 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t5) On stable topology update. Pending txs: 0 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t2) On stable topology update. Pending txs: 0 14:54:29,108 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling topology 24 is installed 14:54:29,108 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t3) [Context=opt-cache][Scope=test-NodeD-25447]ISPN100003: Node test-NodeD-25447 finished rebalance phase with topology id 24 14:54:29,108 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t3) Rebalance confirmation collector 24@opt-cache received confirmation for test-NodeD-25447, remaining list is [test-NodeA-55522, test-NodeC-10992] 14:54:29,108 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache opt-cache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:29,108 DEBUG [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeA-55522, topology id = 24 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t1) On stable topology update. Pending txs: 0 14:54:29,108 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,108 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) On cache ___defaultcache we have: added segments: {}; removed segments: {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254} 14:54:29,108 INFO [org.infinispan.CLUSTER] (remote-thread-test-NodeC-p146-t5) [Context=opt-cache][Scope=test-NodeA-55522]ISPN100003: Node test-NodeA-55522 finished rebalance phase with topology id 24 14:54:29,108 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]} 14:54:29,108 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (remote-thread-test-NodeC-p146-t5) Rebalance confirmation collector 24@opt-cache received confirmation for test-NodeA-55522, remaining list is [test-NodeC-10992] 14:54:29,108 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t6) Signalling transaction data received for topology 24 14:54:29,108 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,108 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t4) Signalling transaction data received for topology 25 14:54:29,108 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:29,108 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:29,108 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,108 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t4) Removing no longer owned entries for cache ___defaultcache 14:54:29,108 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_PHASE_CONFIRM, sender=test-NodeC-10992, joinInfo=null, topologyId=24, rebalanceId=6, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=30} 14:54:29,108 DEBUG [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) ISPN000328: Finished local rebalance for cache opt-cache on node test-NodeC-10992, topology id = 24 14:54:29,108 INFO [org.infinispan.CLUSTER] (transport-thread-test-NodeC-p148-t2) [Context=opt-cache][Scope=test-NodeC-10992]ISPN100003: Node test-NodeC-10992 finished rebalance phase with topology id 24 14:54:29,108 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,108 TRACE [org.infinispan.topology.RebalanceConfirmationCollector] (transport-thread-test-NodeC-p148-t2) Rebalance confirmation collector 24@opt-cache received confirmation for test-NodeC-10992, remaining list is [] 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) On stable topology update. Pending txs: 0 14:54:29,108 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Cache opt-cache topology updated: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, members = [test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], joiners = [] 14:54:29,108 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t4) Updating stable topology for cache ___defaultcache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,108 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t2) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,108 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Topology changed, recalculating minTopologyId 14:54:29,108 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t6) Minimum topology ID still is 15; nothing to change 14:54:29,108 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Updating cluster-wide current topology for cache opt-cache, topology = CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]}, availability mode = AVAILABLE 14:54:29,109 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 90+85, test-NodeB-18592: 82+87, test-NodeD-25447: 84+93, test-NodeC-10992: 0+119]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, unionConsistentHash=null, newTopologyId=24} 14:54:29,109 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,108 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t4) On stable topology update. Pending txs: 0 14:54:29,109 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t6) On stable topology update. Pending txs: 0 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992: sending test-NodeC-10992#17 14:54:29,109 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 14:54:29,109 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating local topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeC-p148-t4) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,109 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 used 3398 credits, 1930360 remaining 14:54:29,109 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeC-p148-t4) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3398 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 14:54:29,109 TRACE [org.infinispan.topology.ClusterCacheStatus] (transport-thread-test-NodeC-p148-t2) Updating stable topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3398 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#17 14:54:29,109 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#17 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3398 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=17], TP: [cluster_name=ISPN] 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#17 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#17 14:54:29,109 DEBUG [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Updating cluster-wide stable topology for cache opt-cache, topology = CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#17 14:54:29,109 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,109 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 sending command to all: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,109 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,109 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,109 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,109 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeC-10992 used 3398 credits, 1930360 remaining 14:54:29,109 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,109 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,109 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 3398 credits, 1930371 remaining 14:54:29,109 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t6) Updating local topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#17 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992: sending test-NodeC-10992#18 14:54:29,109 TRACE [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Attempting to execute command on self: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [MSG, seqno=18], TP: [cluster_name=ISPN] 14:54:29,109 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,109 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeB-p140-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,109 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeB-p140-t6) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,109 TRACE [org.jgroups.protocols.MFC] (transport-thread-test-NodeC-p148-t2) test-NodeC-10992 used 3396 credits, 1926964 remaining 14:54:29,109 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=3396 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=18], TP: [cluster_name=ISPN] 14:54:29,109 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=3396 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=18], TP: [cluster_name=ISPN] 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received test-NodeC-10992#18 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: delivering test-NodeC-10992#18 14:54:29,109 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,109 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeD-25447) test-NodeD-25447 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,109 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-15,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,109 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=3396 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [MSG, seqno=18], TP: [cluster_name=ISPN] 14:54:29,109 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeD-25447) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,109 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Updating local topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeB-p140-t6) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling topology 25 is installed 14:54:29,109 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeA-p132-t6) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,109 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: new segments: {12-13 16-17 19-20 22-25 27-31 40-41 50-51 53-54 56-57 61-70 72-74 77-80 83-84 86-89 92-96 101-107 118-120 126-128 132-136 148-151 154-155 158-165 167-168 171-172 174-176 179-182 184-186 189-190 193-194 196-197 207-208 211-212 214-215 218-219 224-226 235-236 240-242 245-251}; old segments: {5-7 12-13 15-20 22-25 27-32 39-41 45-51 53-59 61-70 72-74 76-84 86-89 92-109 118-120 126-128 132-137 139-144 148-151 154-155 158-168 171-172 174-176 178-186 188-198 207-208 211-212 214-215 218-219 221-222 224-226 235-236 240-242 245-253} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeA-p132-t6) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,110 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeA-55522 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t5) Updating stable topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,110 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) Check if topology CacheTopology{id=24, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) On stable topology update. Pending txs: 0 14:54:29,110 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeB-18592 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received test-NodeC-10992#18 14:54:29,109 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-15,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,110 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeD-p156-t5) Updating local topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,109 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeC-p148-t4) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t4) Signalling topology 25 is installed 14:54:29,110 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeC-10992 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) On cache opt-cache we have: new segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254}; old segments: {2-3 5-8 15-16 18-19 28-32 36-37 39-42 44-50 54-55 57-59 65-66 75-76 80-83 85-86 89-92 97-101 107-115 124-125 131-132 136-146 162-166 173-175 177-178 180-181 183-184 188-189 191-193 195-198 217-218 221-223 225-227 229-230 244-250 252-254} 14:54:29,110 TRACE [org.infinispan.topology.CacheTopology] (transport-thread-test-NodeD-p156-t5) Current consistent hash's routing table: test-NodeA-55522 primary: {0 2 4 9 11 14 18 22 27 34-35 39 43 47 49 52 56 61 68 71 75 82 91 94-95 103 112-113 118-119 123 130 138 143 148 150 152-153 158 161 169-170 173 177 188 191-192 195 200-202 207 209 211 214 216 221 228 231-232 235 237-239 244 252 255}, backup: {1 3 6-8 10 13 17 21 26 33 38 42 45-46 48 51 55 60 67 69-70 74 81 90 93 102 111 116-117 121-122 129 137 142 147 149 151 156-157 159-160 168 172 176 187 190 194 199 203-206 208 210 213 215 220 227 230 233-234 236 243 251 253-254} test-NodeB-18592 primary: {13 17 20 23 25 28 30-31 41 51 54 57 62 65 67 69-70 74 78 80 84 87 89 93 96 102 104 107 120 128 133 136 149 151 155 159-160 162-165 168 172 176 180 182 185-186 190 194 197 208 212 215 219 225-226 236 242 246 248-249 251}, backup: {12 16 19 22 24 27 29 40 50 53 56 61 63-64 66 68 72-73 77 79 83 86 88 92 94-95 101 103 105-106 118-119 126-127 132 134-135 148 150 154 158 161 167 171 174-175 179 181 184 189 193 196 207 211 214 218 224 235 240-241 245 247 250} test-NodeC-10992 primary: {3 6-8 16 19 29 32 37 40 42 45-46 48 50 55 58-59 66 76 81 83 86 90 92 98 101 108-109 111 114-115 125 132 137 139 142 144 146 166 174-175 178 181 184 189 193 196 198 218 222-223 227 230 245 247 250 253-254}, backup: {2 5 15 18 28 30-31 36 39 41 44 47 49 54 57 65 75 80 82 85 89 91 97 99-100 107 110 112-113 124 131 136 138 140-141 143 145 162-165 173 177 180 183 188 191-192 195 197 217 221 225-226 229 244 246 248-249 252} test-NodeD-25447 primary: {1 5 10 12 15 21 24 26 33 36 38 44 53 60 63-64 72-73 77 79 85 88 97 99-100 105-106 110 116-117 121-122 124 126-127 129 131 134-135 140-141 145 147 154 156-157 167 171 179 183 187 199 203-206 210 213 217 220 224 229 233-234 240-241 243}, backup: {0 4 9 11 14 20 23 25 32 34-35 37 43 52 58-59 62 71 76 78 84 87 96 98 104 108-109 114-115 120 123 125 128 130 133 139 144 146 152-153 155 166 169-170 178 182 185-186 198 200-202 209 212 216 219 222-223 228 231-232 237-239 242 255} 14:54:29,109 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received test-NodeC-10992#18 14:54:29,110 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeD-25447 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) On cache opt-cache we have: added segments: {}; removed segments: {} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferManagerImpl] (transport-thread-test-NodeD-p156-t5) Installing new cache topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} on cache opt-cache 14:54:29,110 TRACE [org.jgroups.protocols.MFC] (jgroups-15,test-NodeD-25447) test-NodeC-10992 used 3396 credits, 1930362 remaining 14:54:29,110 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#18 14:54:29,110 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,110 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) On cache opt-cache we have: added segments: {}; removed segments: {5-7 15 18 32 39 45-49 55 58-59 76 81-82 97-100 108-109 137 139-144 166 178 183 188 191-192 195 198 221-222 252-253} 14:54:29,109 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeD-25447) Added a new task directly: 0 task(s) are waiting 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,110 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-17,test-NodeA-55522) test-NodeA-55522 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,110 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeA-p132-t6) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling topology 25 is installed 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,110 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: delivering test-NodeC-10992#18 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeC-p148-t4) Signalling transaction data received for topology 25 14:54:29,110 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-17,test-NodeA-55522) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,110 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 1 14:54:29,110 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-17,test-NodeA-55522) Added a new task directly: 0 task(s) are waiting 14:54:29,110 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Checking transaction GlobalTx:test-NodeA-55522:15 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeB-p140-t6) Signalling transaction data received for topology 25 14:54:29,110 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=true, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,110 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,110 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Received new topology for cache opt-cache, isRebalance = false, isMember = true, topology = CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.conflict.impl.DefaultConflictManager] (transport-thread-test-NodeD-p156-t5) (isRunning=true) Installed new topology 25: CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling topology 25 is installed 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache opt-cache we have: new segments: {0-1 4-5 9-12 14-15 20-21 23-26 32-38 43-44 52-53 58-60 62-64 71-73 76-79 84-85 87-88 96-100 104-106 108-110 114-117 120-131 133-135 139-141 144-147 152-157 166-167 169-171 178-179 182-183 185-187 198-206 209-210 212-213 216-217 219-220 222-224 228-229 231-234 237-243 255}; old segments: {0-5 8-12 14-16 19-21 23-26 28-38 41-44 52-53 58-60 62-64 71-73 75-79 83-85 87-92 96-101 104-106 108-117 120-131 133-135 138-141 144-147 152-159 162-171 173-174 177-187 197-206 209-210 212-213 216-217 219-220 222-224 227-234 237-245 248-250 254-255} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) On cache opt-cache we have: added segments: {}; removed segments: {2-3 8 16 19 28-31 41-42 75 83 89-92 101 111-113 138 158-159 162-165 168 173-174 177 180-181 184 197 227 230 244-245 248-250 254} 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeD-p156-t5) Signalling transaction data received for topology 25 14:54:29,110 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,110 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,110 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Removing no longer owned entries for cache opt-cache 14:54:29,110 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (transport-thread-test-NodeD-p156-t5) Invoked with command InvalidateCommand{keys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7f9a358f] 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (transport-thread-test-NodeD-p156-t5) handleNonTxWriteCommand for command InvalidateCommand{keys=[MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}]}, topology id -1 14:54:29,110 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (transport-thread-test-NodeD-p156-t5) Setting command topology to 25 14:54:29,110 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeD-p156-t5) Exists in context? null 14:54:29,110 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeD-p156-t5) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,110 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeD-p156-t5) Creating new entry for key MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992} 14:54:29,110 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeD-p156-t5) Updated context entry null -> VersionedRepeatableReadEntry(715dd40c){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,110 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (transport-thread-test-NodeD-p156-t5) Invoking: InvalidateCommand 14:54:29,110 TRACE [org.infinispan.commands.write.InvalidateCommand] (transport-thread-test-NodeD-p156-t5) Invalidating keys [MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}] 14:54:29,110 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (transport-thread-test-NodeD-p156-t5) About to commit entry VersionedRepeatableReadEntry(715dd40c){key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, isCreated=false, isChanged=true, isRemoved=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,111 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t5) Trying to commit. Key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. Operation Flag=null, L1 invalidation=false 14:54:29,111 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeD-p156-t5) Committing key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:29,111 TRACE [org.infinispan.container.DefaultDataContainer] (transport-thread-test-NodeD-p156-t5) Removed MetadataImmortalCacheEntry{key=MagicKey#k2{9/0AD74A7B/101@test-NodeC-10992}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} from container 14:54:29,111 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeD-p156-t5) Removed 1 keys, data container now has 0 keys 14:54:29,111 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@1c944c4f passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,111 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) Topology changed, recalculating minTopologyId 14:54:29,111 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeD-p156-t5) Changing minimum topology ID from 24 to 25 14:54:29,111 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeD-p156-t5) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@5108edf2 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeD-25447, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeD-p156-t5) On stable topology update. Pending txs: 0 14:54:29,110 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeD-25447) test-NodeC-10992 used 3398 credits, 1926964 remaining 14:54:29,110 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeB-p140-t6) Removing no longer owned entries for cache opt-cache 14:54:29,111 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@14c3622c passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,111 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Topology changed, recalculating minTopologyId 14:54:29,111 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeB-p140-t6) Changing minimum topology ID from 24 to 25 14:54:29,111 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeB-p140-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@2cab9aaf passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeB-18592, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t6) On stable topology update. Pending txs: 0 14:54:29,110 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,110 TRACE [org.jgroups.protocols.MFC] (jgroups-17,test-NodeA-55522) test-NodeC-10992 used 3396 credits, 1926975 remaining 14:54:29,110 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache opt-cache we have: new segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-35 38-39 42-43 45-49 51-52 55-56 60-61 67-71 74-75 81-82 90-91 93-95 102-103 111-113 116-119 121-123 129-130 137-138 142-143 147-153 156-161 168-170 172-173 176-177 187-188 190-192 194-195 199-211 213-216 220-221 227-228 230-239 243-244 251-255}; old segments: {0-4 6-11 13-14 17-18 21-22 26-27 33-40 42-52 54-58 60-61 65-71 74-75 80-82 85-86 90-91 93-95 102-103 107-108 110-119 121-125 129-132 134-138 142-143 145-153 156-161 168-170 172-177 187-196 199-211 213-218 220-223 225-239 243-244 246-247 251-255} 14:54:29,111 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) On cache opt-cache we have: added segments: {}; removed segments: {36-37 40 44 50 54 57-58 65-66 80 85-86 107-108 110 114-115 124-125 131-132 134-136 145-146 174-175 189 193 196 217-218 222-223 225-226 229 246-247} 14:54:29,111 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeC-p148-t4) Removing no longer owned entries for cache opt-cache 14:54:29,111 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Topology update processed, stateTransferTopologyId = -1, startRebalance = false, pending CH = null 14:54:29,111 TRACE [org.infinispan.statetransfer.StateTransferLockImpl] (transport-thread-test-NodeA-p132-t6) Signalling transaction data received for topology 25 14:54:29,111 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeB-18592) test-NodeB-18592 received command from test-NodeC-10992: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} 14:54:29,111 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) Checking for transactions originated on leavers. Current cache members are [test-NodeC-10992, test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], remote transactions: 0 14:54:29,111 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) No remote transactions pertain to originator(s) who have left the cluster. 14:54:29,111 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@6851dc54 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,111 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeB-18592) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeC-10992, joinInfo=null, topologyId=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=30} [sender=test-NodeC-10992] 14:54:29,111 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Topology changed, recalculating minTopologyId 14:54:29,111 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeB-18592) Added a new task directly: 0 task(s) are waiting 14:54:29,111 DEBUG [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Removing no longer owned entries for cache opt-cache 14:54:29,111 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeB-18592) test-NodeC-10992 used 3396 credits, 1926964 remaining 14:54:29,111 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeC-p148-t4) Minimum topology ID still is 15; nothing to change 14:54:29,111 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeB-p140-t1) Updating stable topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,111 TRACE [org.infinispan.interceptors.impl.InvocationContextInterceptor] (transport-thread-test-NodeA-p132-t6) Invoked with command InvalidateCommand{keys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}]} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@3e50680b] 14:54:29,111 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeC-p148-t4) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@282ab520 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeC-10992, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,111 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (transport-thread-test-NodeA-p132-t6) handleNonTxWriteCommand for command InvalidateCommand{keys=[MagicKey#k1{8/537A1109/107@test-NodeB-18592}]}, topology id -1 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,111 TRACE [org.infinispan.statetransfer.StateTransferInterceptor] (transport-thread-test-NodeA-p132-t6) Setting command topology to 25 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) On stable topology update. Pending txs: 0 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeB-p140-t1) On stable topology update. Pending txs: 0 14:54:29,111 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeA-p132-t6) Exists in context? null 14:54:29,111 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Updating stable topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,111 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeA-p132-t6) Retrieved from container MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,111 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeA-p132-t6) Creating new entry for key MagicKey#k1{8/537A1109/107@test-NodeB-18592} 14:54:29,111 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeC-p148-t4) On stable topology update. Pending txs: 0 14:54:29,111 TRACE [org.infinispan.container.EntryFactoryImpl] (transport-thread-test-NodeA-p132-t6) Updated context entry null -> VersionedRepeatableReadEntry(3a6ffb19){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=false, isRemoved=false, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,111 TRACE [org.infinispan.interceptors.impl.CallInterceptor] (transport-thread-test-NodeA-p132-t6) Invoking: InvalidateCommand 14:54:29,111 TRACE [org.infinispan.commands.write.InvalidateCommand] (transport-thread-test-NodeA-p132-t6) Invalidating keys [MagicKey#k1{8/537A1109/107@test-NodeB-18592}] 14:54:29,111 TRACE [org.infinispan.interceptors.impl.EntryWrappingInterceptor] (transport-thread-test-NodeA-p132-t6) About to commit entry VersionedRepeatableReadEntry(3a6ffb19){key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, isCreated=false, isChanged=true, isRemoved=true, isExpired=false, skipLookup=false, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} 14:54:29,112 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t6) Trying to commit. Key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. Operation Flag=null, L1 invalidation=false 14:54:29,112 TRACE [org.infinispan.statetransfer.CommitManager] (transport-thread-test-NodeA-p132-t6) Committing key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}. It is a L1 invalidation or a normal put and no tracking is enabled! 14:54:29,112 TRACE [org.infinispan.container.DefaultDataContainer] (transport-thread-test-NodeA-p132-t6) Removed MetadataImmortalCacheEntry{key=MagicKey#k1{8/537A1109/107@test-NodeB-18592}, value=final-value, metadata=EmbeddedExpirableMetadata{lifespan=-1, maxIdle=-1, version=SimpleClusteredVersion{topologyId=16, version=2}}} from container 14:54:29,112 TRACE [org.infinispan.statetransfer.StateConsumerImpl] (transport-thread-test-NodeA-p132-t6) Removed 1 keys, data container now has 0 keys 14:54:29,112 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.transaction.xa.XaTransactionTable@5d8cc6f3 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,112 DEBUG [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) Topology changed, recalculating minTopologyId 14:54:29,112 TRACE [org.infinispan.transaction.impl.TransactionTable] (transport-thread-test-NodeA-p132-t6) Changing minimum topology ID from 24 to 25 14:54:29,112 TRACE [org.infinispan.notifications.cachelistener.CacheNotifierImpl] (transport-thread-test-NodeA-p132-t6) Invoking listener: org.infinispan.container.versioning.SimpleClusteredVersionGenerator$TopologyIdUpdater@52bca0a7 passing event EventImpl{type=TOPOLOGY_CHANGED, pre=false, cache=Cache 'opt-cache'@test-NodeA-55522, readConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtStart=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+108, test-NodeB-18592: 63+106, test-NodeC-10992: 59+60, test-NodeD-25447: 67+110]}, readConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, writeConsistentHashAtEnd=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionConsistentHash=null, newTopologyId=25} 14:54:29,112 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,112 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) On stable topology update. Pending txs: 0 14:54:29,112 TRACE [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeA-p132-t6) Updating stable topology for cache opt-cache: CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,112 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) Check if topology CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} is stable. Last stable topology is CacheTopology{id=25, rebalanceId=6, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,112 TRACE [org.infinispan.partitionhandling.impl.PartitionHandlingManagerImpl] (transport-thread-test-NodeA-p132-t6) On stable topology update. Pending txs: 0 14:54:29,146 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeA-55522: #32) 14:54:29,146 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=32, conn_id=1, ts=13, TP: [cluster_name=ISPN] 14:54:29,146 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeB-18592: #28) 14:54:29,146 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeB-18592, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=28, conn_id=1, ts=14, TP: [cluster_name=ISPN] 14:54:29,146 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeC-10992) test-NodeC-10992 --> ACK(test-NodeD-25447: #18) 14:54:29,146 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeD-25447, src=test-NodeC-10992, headers are UNICAST3: ACK, seqno=18, conn_id=2, ts=15, TP: [cluster_name=ISPN] 14:54:29,146 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=32, conn_id=1, ts=13, TP: [cluster_name=ISPN] 14:54:29,146 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-17,test-NodeA-55522) test-NodeA-55522 <-- ACK(test-NodeC-10992: #32, conn-id=1, ts=13) 14:54:29,146 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=28, conn_id=1, ts=14, TP: [cluster_name=ISPN] 14:54:29,146 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeC-10992: #28, conn-id=1, ts=14) 14:54:29,146 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=18, conn_id=2, ts=15, TP: [cluster_name=ISPN] 14:54:29,146 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeC-10992: #18, conn-id=2, ts=15) 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending XMIT_REQ ((51): {1-51}) to test-NodeA-55522 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are NAKACK2: [XMIT_REQ, sender=test-NodeA-55522], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (2 headers), size=21 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [XMIT_REQ, sender=test-NodeA-55522], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received xmit request from test-NodeC-10992 for test-NodeA-55522(51): {1-51} 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::1 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=1, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=1], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::2 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are GMS: GmsHeader[VIEW], NAKACK2: [XMIT_RSP, seqno=2], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=1, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=1], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#1 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::3 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#1 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=3], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 1 from test-NodeA-55522: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:29,147 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeA-55522] 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::4 14:54:29,147 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=4], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received message batch of 1 messages from test-NodeA-55522 14:54:29,147 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 1 to test-NodeA-55522: SuccessfulResponse(true) 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=5371 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=3], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 7 credits, 1996659 remaining 14:54:29,147 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeA-55522: #40, conn_id=0) 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::5 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#2-2 (1 messages) 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=5372 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=4], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#3 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#4 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#2-2 (1 messages) 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#4 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=5], TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=1, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:29,147 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#3 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::6 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=5372 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=5], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#5 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=6], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#5 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} [sender=test-NodeA-55522] 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} [sender=test-NodeA-55522] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::7 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=1, rsp_expected=true, UNICAST3: DATA, seqno=40, TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,148 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 5371 credits, 1991288 remaining 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=7], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} 14:54:29,148 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #40, conn_id=0) 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::8 14:54:29,148 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 5372 credits, 1985916 remaining 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} [sender=test-NodeA-55522] 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=3, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=8], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#40 14:54:29,148 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::9 14:54:29,148 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeC-10992) test-NodeA-55522 used 5372 credits, 1980544 remaining 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 1 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are GMS: GmsHeader[VIEW], NAKACK2: [XMIT_RSP, seqno=9], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-15,test-NodeA-55522) Ignoring response for non-existent request 1 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,148 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring old rebalance for cache ___defaultcache, current topology is 25: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::10 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=10], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3278 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=7], TP: [cluster_name=ISPN] 14:54:29,148 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3280 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=6], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::11 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#7 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received message batch of 1 messages from test-NodeA-55522 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6481 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=10], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=3, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=8], TP: [cluster_name=ISPN] 14:54:29,148 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=11], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#7 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#8 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#9-9 (1 messages) 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#9-9 (1 messages) 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#10 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::12 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#8 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#6 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=12], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} [sender=test-NodeA-55522] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#10 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::13 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=13], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#6 14:54:29,148 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Ignoring topology 5 for cache ___defaultcache from old coordinator test-NodeA-55522 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::14 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received request 3 from test-NodeA-55522: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=14], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeA-55522] 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} [sender=test-NodeA-55522] 14:54:29,148 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,148 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 3278 credits, 1977266 remaining 14:54:29,148 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 sending response for request 3 to test-NodeA-55522: SuccessfulResponse(true) 14:54:29,148 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 6481 credits, 1974063 remaining 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::15 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=5, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=15], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6482 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=12], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#12 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6482 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=11], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 7 credits, 1980537 remaining 14:54:29,148 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring old rebalance for cache ___defaultcache, current topology is 25: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#11 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3340 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=14], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#14 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#14 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=5, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=15], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=1} [sender=test-NodeA-55522] 14:54:29,148 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=13], TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,148 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#11 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#12 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#13 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::16 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#13 14:54:29,148 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 --> DATA(test-NodeA-55522: #41, conn_id=0) 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=3, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-22,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} 14:54:29,148 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-22,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-22,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-22,test-NodeC-10992) test-NodeA-55522 used 6482 credits, 1964296 remaining 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=3, rsp_expected=true, UNICAST3: DATA, seqno=41, TP: [cluster_name=ISPN] 14:54:29,148 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeC-10992) test-NodeA-55522 used 3280 credits, 1967498 remaining 14:54:29,148 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#15 14:54:29,149 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #41, conn_id=0) 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#15 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received request 5 from test-NodeA-55522: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring topology 9 for cache ___defaultcache from old coordinator test-NodeA-55522 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 3340 credits, 1967438 remaining 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are GMS: GmsHeader[VIEW], NAKACK2: [XMIT_RSP, seqno=16], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-23,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::17 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 6482 credits, 1951194 remaining 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 sending response for request 5 to test-NodeA-55522: SuccessfulResponse(true) 14:54:29,149 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-15,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#41 14:54:29,149 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992 --> DATA(test-NodeA-55522: #42, conn_id=0) 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-15,test-NodeA-55522) test-NodeA-55522 received response for request 3 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t5) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=5, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 7 credits, 1951187 remaining 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-23,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=2} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received message batch of 1 messages from test-NodeA-55522 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=17], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-15,test-NodeA-55522) Ignoring response for non-existent request 3 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#16-16 (1 messages) 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=5, rsp_expected=true, UNICAST3: DATA, seqno=42, TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#16-16 (1 messages) 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-23,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6567 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=17], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::18 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#17 14:54:29,149 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #42, conn_id=0) 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#17 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=18], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-23,test-NodeC-10992) test-NodeA-55522 used 3342 credits, 1947845 remaining 14:54:29,149 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#42 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 5 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,149 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-6,test-NodeA-55522) Ignoring response for non-existent request 5 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::19 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=19], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=18], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 6567 credits, 1941278 remaining 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#18 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::20 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#18 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=20], TP: [cluster_name=ISPN] 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Ignoring old rebalance for cache ___defaultcache, current topology is 25: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6568 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=19], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#19 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::21 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#19 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-23,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=21], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3404 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=20], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::22 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-23,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-23,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-23,test-NodeC-10992) test-NodeA-55522 used 6568 credits, 1934710 remaining 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#20 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#20 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 6568 credits, 1934710 remaining 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3402 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=21], TP: [cluster_name=ISPN] 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=22], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#21 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::23 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#21 14:54:29,149 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=23], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=2186 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=22], TP: [cluster_name=ISPN] 14:54:29,149 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 3404 credits, 1924738 remaining 14:54:29,149 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::24 14:54:29,149 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,149 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=5365 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=23], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#23 14:54:29,149 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#22 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#23 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#22 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring topology 13 for cache ___defaultcache from old coordinator test-NodeA-55522 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 3402 credits, 1921336 remaining 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=24], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=1, rebalanceId=1, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::25 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring topology 1 for cache opt-cache from old coordinator test-NodeA-55522 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=24], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 2186 credits, 1919150 remaining 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#24 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=25], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#24 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::26 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=26], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::27 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring old rebalance for cache opt-cache, current topology is 25: CacheTopology{id=2, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=27], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=5366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=25], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3274 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=26], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::28 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#25 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#25 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 5365 credits, 1913785 remaining 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3272 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=27], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=28], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#27 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=3, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#26 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::29 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=29], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#26 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 5366 credits, 1908419 remaining 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::30 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#27 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=29], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#29 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#29 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 5366 credits, 1903053 remaining 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=4, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (1)[test-NodeA-55522: 256+0]}, pendingCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6475 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=28], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-23,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#28 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=30], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-22,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::31 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-22,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#28 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Ignoring topology 5 for cache opt-cache from old coordinator test-NodeA-55522 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-23,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-22,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-23,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=31], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-22,test-NodeC-10992) test-NodeA-55522 used 6476 credits, 1896577 remaining 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-23,test-NodeC-10992) test-NodeA-55522 used 3274 credits, 1899779 remaining 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6476 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=30], TP: [cluster_name=ISPN] 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=7, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeC-10992) test-NodeA-55522 used 3272 credits, 1899781 remaining 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#30 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#30 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 6475 credits, 1883556 remaining 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=5, rebalanceId=2, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5]} 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=31], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::32 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#31 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring old rebalance for cache opt-cache, current topology is 25: CacheTopology{id=6, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#31 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=32], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,150 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,150 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::33 14:54:29,150 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 6476 credits, 1877080 remaining 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3334 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=32], TP: [cluster_name=ISPN] 14:54:29,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=33], TP: [cluster_name=ISPN] 14:54:29,150 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=8, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (2)[test-NodeA-55522: 132+124, test-NodeB-18592: 124+132]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,150 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#32 14:54:29,150 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#32 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::34 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeC-10992) test-NodeA-55522 used 3336 credits, 1873744 remaining 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06]} 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6561 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=33], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=34], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#33 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#33 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=9, rebalanceId=3, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::35 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 3334 credits, 1870410 remaining 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=35], TP: [cluster_name=ISPN] 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Ignoring topology 9 for cache opt-cache from old coordinator test-NodeA-55522 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=34], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::36 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6562 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=35], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#34 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=36], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#34 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#35 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#35 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::37 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3398 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=36], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=37], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::38 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-6,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=38], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3396 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=37], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=11, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::39 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#36 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=39], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#37 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#36 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring old rebalance for cache opt-cache, current topology is 25: CacheTopology{id=10, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 6561 credits, 1863849 remaining 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-6,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (3 headers), size=7 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are RequestCorrelator: corr_id=0, type=REQ, req_id=15, rsp_expected=true, NAKACK2: [XMIT_RSP, seqno=38], TP: [cluster_name=ISPN] 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=12, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+76, test-NodeB-18592: 88+87, test-NodeC-10992: 78+93]}, pendingCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#38 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::40 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#37 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 6562 credits, 1863848 remaining 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3360 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=39], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=40], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#38 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-22,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-23,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-22,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::41 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-6,test-NodeC-10992) test-NodeA-55522 used 6562 credits, 1857287 remaining 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received request 15 from test-NodeA-55522: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#39 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=null, type=POLICY_GET_STATUS, sender=null, joinInfo=null, topologyId=0, rebalanceId=0, currentCH=null, pendingCH=null, availabilityMode=null, phase=null, actualMembers=null, throwable=null, viewId=0} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=2860 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=40], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-23,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], throwable=null, viewId=3} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#40 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-23,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#40 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-22,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-23,test-NodeC-10992) test-NodeA-55522 used 3398 credits, 1847327 remaining 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Ignoring topology 13 for cache opt-cache from old coordinator test-NodeA-55522 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#39 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=41], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 7 credits, 1847320 remaining 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 sending response for request 15 to test-NodeA-55522: SuccessfulResponse(true) 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-22,test-NodeC-10992) test-NodeA-55522 used 3396 credits, 1843931 remaining 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6023 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=41], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=13, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::42 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 2860 credits, 1844460 remaining 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=42], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#41 14:54:29,151 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#41 14:54:29,151 TRACE [org.jgroups.protocols.UNICAST3] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992 --> DATA(test-NodeA-55522: #43, conn_id=0) 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::43 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3366 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=42], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=43], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#42 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-10,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#42 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::44 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-23,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=44], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-10,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,151 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::45 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=2866 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=43], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=45], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#43 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#43 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::46 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6030 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=45], TP: [cluster_name=ISPN] 14:54:29,151 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 3360 credits, 1841100 remaining 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#45 14:54:29,151 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-22,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=46], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6029 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=44], TP: [cluster_name=ISPN] 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-10,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,151 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-23,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::47 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-10,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,151 TRACE [org.jgroups.protocols.TCP_NIO2] (remote-thread-test-NodeC-p146-t3) test-NodeC-10992: sending msg to test-NodeA-55522, src=test-NodeC-10992, headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=47], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-22,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::48 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#45 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#44 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-22,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=14, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-22,test-NodeC-10992) test-NodeA-55522 used 2866 credits, 1834838 remaining 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6024 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=46], TP: [cluster_name=ISPN] 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring old rebalance for cache opt-cache, current topology is 25: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6030 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=47], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#46 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#47 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-10,test-NodeC-10992) test-NodeA-55522 used 3366 credits, 1834338 remaining 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-22,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#47 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-20,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#46 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=15, rebalanceId=4, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-23,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeA-55522) test-NodeA-55522: received [dst: test-NodeA-55522, src: test-NodeC-10992 (3 headers), size=5 bytes, flags=OOB|NO_FC|NO_TOTAL_ORDER], headers are RequestCorrelator: corr_id=0, type=RSP, req_id=15, rsp_expected=true, UNICAST3: DATA, seqno=43, TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=48], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-22,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#44 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-20,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-22,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522 <-- DATA(test-NodeC-10992: #43, conn_id=0) 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-22,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-22,test-NodeC-10992) test-NodeA-55522 used 6030 credits, 1828808 remaining 14:54:29,152 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeA-55522) test-NodeA-55522: delivering test-NodeC-10992#43 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t3) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-23,test-NodeC-10992) test-NodeA-55522 used 6023 credits, 1828815 remaining 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=REBALANCE_START, sender=test-NodeA-55522, joinInfo=null, topologyId=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-6,test-NodeA-55522) test-NodeA-55522 received response for request 15 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-20,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::49 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-20,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-20,test-NodeC-10992) test-NodeA-55522 used 6024 credits, 1813395 remaining 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Ignoring old rebalance for cache ___defaultcache, current topology is 25: CacheTopology{id=16, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_OLD_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t4) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 6030 credits, 1813389 remaining 14:54:29,152 TRACE [org.infinispan.remoting.transport.impl.RequestRepository] (jgroups-6,test-NodeA-55522) Ignoring response for non-existent request 15 from test-NodeC-10992: SuccessfulResponse(true) 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t1) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=17, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_ALL_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 6029 credits, 1807366 remaining 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=6024 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=48], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=49], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#48 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#48 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::50 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=50], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3342 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=49], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#49 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-23,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: resending test-NodeA-55522::51 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-7,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#49 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3340 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=50], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-23,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, availabilityMode=AVAILABLE, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are NAKACK2: [XMIT_RSP, seqno=51], TP: [cluster_name=ISPN] 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-7,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#50 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-23,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#50 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-7,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-23,test-NodeC-10992) test-NodeA-55522 used 6024 credits, 1795312 remaining 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-7,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-21,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-7,test-NodeC-10992) test-NodeA-55522 used 3342 credits, 1791970 remaining 14:54:29,152 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-21,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=___defaultcache, type=STABLE_TOPOLOGY_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=null, phase=null, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,152 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=3336 bytes, flags=OOB|NO_TOTAL_ORDER|NO_RELAY], headers are NAKACK2: [XMIT_RSP, seqno=51], TP: [cluster_name=ISPN] 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t2) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=18, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 85+49, test-NodeB-18592: 85+41, test-NodeD-25447: 86+47]}, pendingCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, unionCH=null, phase=READ_NEW_WRITE_ALL, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Ignoring late consistent hash update for cache ___defaultcache, current topology is 25: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,152 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-21,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received test-NodeA-55522#51 14:54:29,152 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t6) Ignoring topology 19 for cache ___defaultcache from old coordinator test-NodeA-55522 14:54:29,152 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: delivering test-NodeA-55522#51 14:54:29,152 TRACE [org.jgroups.protocols.MFC] (jgroups-21,test-NodeC-10992) test-NodeA-55522 used 3340 credits, 1788630 remaining 14:54:29,153 TRACE [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (jgroups-23,test-NodeC-10992) test-NodeC-10992 received command from test-NodeA-55522: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} 14:54:29,153 TRACE [org.infinispan.remoting.inboundhandler.GlobalInboundInvocationHandler] (jgroups-23,test-NodeC-10992) Attempting to execute non-CacheRpcCommand: CacheTopologyControlCommand{cache=opt-cache, type=CH_UPDATE, sender=test-NodeA-55522, joinInfo=null, topologyId=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, availabilityMode=AVAILABLE, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], throwable=null, viewId=27} [sender=test-NodeA-55522] 14:54:29,153 TRACE [org.infinispan.util.concurrent.BlockingTaskAwareExecutorServiceImpl] (jgroups-23,test-NodeC-10992) Added a new task directly: 0 task(s) are waiting 14:54:29,153 TRACE [org.jgroups.protocols.MFC] (jgroups-23,test-NodeC-10992) test-NodeA-55522 used 3336 credits, 1785294 remaining 14:54:29,153 DEBUG [org.infinispan.topology.LocalTopologyManagerImpl] (transport-thread-test-NodeC-p148-t5) Ignoring late consistent hash update for cache opt-cache, current topology is 25: CacheTopology{id=19, rebalanceId=5, currentCH=DefaultConsistentHash{ns=256, owners = (3)[test-NodeA-55522: 90+83, test-NodeB-18592: 82+83, test-NodeD-25447: 84+90]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,160 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeB-18592: #74) 14:54:29,160 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeB-18592, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=74, ts=16, TP: [cluster_name=ISPN] 14:54:29,160 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeD-25447: #50) 14:54:29,160 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeD-25447, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=50, ts=17, TP: [cluster_name=ISPN] 14:54:29,160 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: test-NodeB-18592, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=74, ts=16, TP: [cluster_name=ISPN] 14:54:29,160 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeA-55522) test-NodeA-55522 --> ACK(test-NodeC-10992: #43) 14:54:29,160 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are UNICAST3: ACK, seqno=43, ts=18, TP: [cluster_name=ISPN] 14:54:29,160 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeB-18592) test-NodeB-18592 <-- ACK(test-NodeA-55522: #74, conn-id=0, ts=16) 14:54:29,160 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=50, ts=17, TP: [cluster_name=ISPN] 14:54:29,160 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeA-55522: #50, conn-id=0, ts=17) 14:54:29,160 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=43, ts=18, TP: [cluster_name=ISPN] 14:54:29,160 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-23,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeA-55522: #43, conn-id=0, ts=18) 14:54:29,161 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,183 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeD-25447: #25) 14:54:29,183 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeD-25447, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=25, conn_id=1, ts=20, TP: [cluster_name=ISPN] 14:54:29,183 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeB-18592) test-NodeB-18592 --> ACK(test-NodeC-10992: #21) 14:54:29,183 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are UNICAST3: ACK, seqno=21, conn_id=1, ts=21, TP: [cluster_name=ISPN] 14:54:29,183 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: test-NodeD-25447, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=25, conn_id=1, ts=20, TP: [cluster_name=ISPN] 14:54:29,183 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-6,test-NodeD-25447) test-NodeD-25447 <-- ACK(test-NodeB-18592: #25, conn-id=1, ts=20) 14:54:29,183 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=21, conn_id=1, ts=21, TP: [cluster_name=ISPN] 14:54:29,183 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-23,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeB-18592: #21, conn-id=1, ts=21) 14:54:29,190 TRACE [org.jgroups.protocols.UNICAST3] (Timer runner-1,test-NodeD-25447) test-NodeD-25447 --> ACK(test-NodeC-10992: #11) 14:54:29,190 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are UNICAST3: ACK, seqno=11, conn_id=2, ts=14, TP: [cluster_name=ISPN] 14:54:29,190 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are UNICAST3: ACK, seqno=11, conn_id=2, ts=14, TP: [cluster_name=ISPN] 14:54:29,190 TRACE [org.jgroups.protocols.UNICAST3] (jgroups-23,test-NodeC-10992) test-NodeC-10992 <-- ACK(test-NodeD-25447: #11, conn-id=2, ts=14) 14:54:29,210 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeA-55522 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,210 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeB-18592 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,210 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeC-10992 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,210 TRACE [org.infinispan.test.TestingUtil] (TestNG) Node test-NodeD-25447 finished state transfer, has topology CacheTopology{id=25, rebalanceId=6, currentCH=PartitionerConsistentHash:DefaultConsistentHash{ns=256, owners = (4)[test-NodeA-55522: 67+67, test-NodeB-18592: 63+63, test-NodeC-10992: 59+60, test-NodeD-25447: 67+66]}, pendingCH=null, unionCH=null, phase=NO_REBALANCE, actualMembers=[test-NodeA-55522, test-NodeB-18592, test-NodeC-10992, test-NodeD-25447], persistentUUIDs=[392a5da1-6e12-417a-b1a8-c0042ca205f4, a513842f-3b63-47f4-8e08-30d8a40bd0c5, a4bb04c4-2aa5-469c-b481-a543584bde06, 2d4a49f6-ead4-4503-aaf3-1f0a60265602]} 14:54:29,210 DEBUG [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Cluster merged 14:54:29,210 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:29,247 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,247 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,247 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,247 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,261 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,261 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,261 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,261 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,347 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,348 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,348 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,348 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,361 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,361 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,361 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,361 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,448 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,448 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,448 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,448 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,461 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,461 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,461 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,461 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,548 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,548 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,548 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,548 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,561 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,562 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,562 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,562 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,648 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,649 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,649 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,649 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,662 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,662 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,662 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,662 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,711 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:29,749 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,749 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,749 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,749 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,762 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,762 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,762 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,762 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,781 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,782 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,782 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,782 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,782 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,782 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,849 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,849 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,849 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,849 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,862 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,863 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,863 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,863 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,894 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,894 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,894 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,894 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,894 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,894 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,906 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,906 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:29,949 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,950 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,950 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,950 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:29,963 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,963 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,963 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:29,963 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,050 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,050 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,050 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,050 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,063 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,063 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,063 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,063 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,150 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,150 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,151 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,163 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,164 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,164 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,164 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,211 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:30,251 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,251 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,251 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,251 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,264 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,264 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,264 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,264 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,297 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending stable msg to test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:30,297 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:30,298 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:30,298 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-23,test-NodeC-10992) test-NodeC-10992: handling digest from test-NodeB-18592: mine: test-NodeC-10992: [-1], test-NodeA-55522: [-1], test-NodeB-18592: [-1], test-NodeD-25447: [-1] other: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] result: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:30,351 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,351 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,351 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,351 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,364 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,452 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,452 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,452 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,452 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,465 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,465 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,465 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,465 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,552 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,552 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,553 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,553 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,565 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,566 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,566 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,566 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,653 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,653 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,653 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,653 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,666 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,666 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,667 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,667 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,711 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:30,753 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,754 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,754 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,754 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,767 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,767 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,767 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,767 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,782 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,782 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,782 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,854 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,854 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,854 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,854 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,867 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,867 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,867 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,868 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,894 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,894 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,894 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,895 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,895 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,895 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,906 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,906 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:30,954 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,955 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,955 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,955 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:30,968 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,968 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,968 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:30,968 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,055 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,055 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,055 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,055 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,068 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,155 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,155 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,168 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,212 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:31,255 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,256 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,256 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,256 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,269 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,269 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,269 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,269 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,356 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,356 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,357 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,357 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,369 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,457 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,457 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,457 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,457 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,470 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,470 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,470 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,470 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,557 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,558 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,558 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,558 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,570 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,571 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,571 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,571 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,658 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,658 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,658 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,658 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,671 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,672 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,672 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,672 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,712 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:31,758 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,759 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,759 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,759 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,772 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,772 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,772 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,772 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,859 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,859 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,859 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,859 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,872 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,873 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,873 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,873 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,895 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,895 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,895 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,907 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,907 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:31,959 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,960 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,960 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,960 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:31,973 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,973 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,974 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:31,974 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,060 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,061 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,061 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,061 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,074 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,161 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,161 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,174 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,174 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,174 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,174 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,213 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:32,261 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,262 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,262 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,262 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,275 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,275 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,275 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,275 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,362 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,362 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,362 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,362 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,375 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,375 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,375 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,375 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,462 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,462 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,462 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,462 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,475 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,476 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,476 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,476 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,562 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,563 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,563 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,563 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,576 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,576 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,576 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,576 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,663 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,663 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,663 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,663 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,676 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,676 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,676 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,677 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,713 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:32,763 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,763 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,763 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,763 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,776 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,777 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,777 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,777 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,783 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,863 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,863 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,863 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,863 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,877 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,877 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,877 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,877 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,895 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,896 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,907 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,907 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,907 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:32,964 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,964 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,964 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,964 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:32,977 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,977 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,977 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:32,977 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,064 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,064 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,064 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,064 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,077 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,078 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,078 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,078 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,164 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,164 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,164 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,164 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,178 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,178 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,178 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,178 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,213 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:33,264 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,265 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,265 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,265 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,278 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,278 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,278 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,278 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,365 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,365 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,378 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,379 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,465 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,465 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,465 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,466 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,479 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,479 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,479 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,479 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,566 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,566 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,566 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,566 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,573 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending stable msg to test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:33,573 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeC-10992, src=test-NodeC-10992, headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:33,573 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: test-NodeC-10992, src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:33,574 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:33,574 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-23,test-NodeC-10992) test-NodeC-10992: handling digest from test-NodeC-10992: mine: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] other: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] result: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:33,579 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,580 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,580 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,580 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,666 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,667 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,667 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,667 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,680 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,681 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,681 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,681 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,714 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:33,767 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,767 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,767 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,767 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,780 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,781 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,781 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,781 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,867 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,867 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,867 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,868 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,881 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,881 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,881 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,881 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,896 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,896 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,896 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,908 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,908 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:33,968 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,968 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,968 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,968 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:33,981 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,982 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,982 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:33,982 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,068 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,068 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,069 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,082 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,082 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,114 DEBUG [org.infinispan.test.fwk.TEST_PING] (Timer runner-1,test-NodeD-25447) Discovery protocol already stopped, so don't look for members 14:54:34,144 DEBUG [org.infinispan.test.fwk.TEST_PING] (Timer runner-1,test-NodeB-18592) Discovery protocol already stopped, so don't look for members 14:54:34,169 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,169 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,182 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,183 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,183 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,183 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,214 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:34,269 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,269 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,269 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,269 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,283 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,283 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,283 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,283 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,370 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,370 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,383 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,384 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,384 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,384 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,470 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,471 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,471 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,471 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,484 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,484 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,485 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,484 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,571 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,571 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,571 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,571 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,584 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,585 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,585 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,585 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,671 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,672 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,672 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,672 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,685 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,686 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,686 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,686 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,714 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:34,772 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,772 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,773 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,773 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,784 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,784 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,834 DEBUG [org.infinispan.test.fwk.TEST_PING] (Timer runner-1,test-NodeC-10992) Discovery protocol already stopped, so don't look for members 14:54:34,873 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,873 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,873 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,873 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,886 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,887 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,887 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,887 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,896 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,896 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,908 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,908 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,908 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,909 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,909 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,909 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:34,973 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,974 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,974 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,974 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:34,987 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,987 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,987 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:34,987 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,074 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,074 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,087 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,088 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,088 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,088 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,174 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,175 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,175 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,175 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,188 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,188 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,188 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,188 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,195 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending stable msg to test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,195 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to test-NodeC-10992, src=test-NodeD-25447, headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,196 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeD-25447 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,196 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-23,test-NodeC-10992) test-NodeC-10992: handling digest from test-NodeD-25447: mine: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] other: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] result: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,215 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:35,221 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending stable msg to test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,221 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to test-NodeC-10992, src=test-NodeB-18592, headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,222 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeB-18592 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,275 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,275 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,275 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,275 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending stable msg to test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to test-NodeC-10992, src=test-NodeA-55522, headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeA-55522 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-23,test-NodeC-10992) test-NodeC-10992: handling digest from test-NodeA-55522: mine: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] other: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] result: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,288 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-23,test-NodeC-10992) test-NodeC-10992: sending stability msg test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are STABLE: [STABILITY] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,288 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received stable digest test-NodeC-10992: [18 (18)], test-NodeA-55522: [52 (52)], test-NodeB-18592: [0 (0)], test-NodeD-25447: [0 (0)] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: deleting msgs <= 18 from test-NodeC-10992 14:54:35,289 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: deleting msgs <= 52 from test-NodeA-55522 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: deleting msgs <= 0 from test-NodeB-18592 14:54:35,289 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received stability msg from test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,289 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABILITY] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received stability msg from test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: deleting msgs <= 0 from test-NodeD-25447 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received stability msg from test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received stable digest test-NodeC-10992: [18 (18)], test-NodeA-55522: [52 (52)], test-NodeB-18592: [0 (0)], test-NodeD-25447: [0 (0)] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received stable digest test-NodeC-10992: [18 (18)], test-NodeA-55522: [52 (52)], test-NodeB-18592: [0 (0)], test-NodeD-25447: [0 (0)] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received stable digest test-NodeC-10992: [18 (18)], test-NodeA-55522: [52 (52)], test-NodeB-18592: [0 (0)], test-NodeD-25447: [0 (0)] 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: deleting msgs <= 18 from test-NodeC-10992 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: deleting msgs <= 18 from test-NodeC-10992 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: deleting msgs <= 52 from test-NodeA-55522 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: deleting msgs <= 18 from test-NodeC-10992 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: deleting msgs <= 0 from test-NodeB-18592 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: deleting msgs <= 52 from test-NodeA-55522 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: deleting msgs <= 0 from test-NodeD-25447 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: deleting msgs <= 52 from test-NodeA-55522 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: deleting msgs <= 0 from test-NodeB-18592 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: deleting msgs <= 0 from test-NodeB-18592 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: deleting msgs <= 0 from test-NodeD-25447 14:54:35,289 TRACE [org.jgroups.protocols.pbcast.NAKACK2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: deleting msgs <= 0 from test-NodeD-25447 14:54:35,375 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,376 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,376 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,376 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,388 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,389 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,476 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,476 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,476 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,476 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,489 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,489 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,489 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,489 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,576 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,577 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,577 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,577 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,589 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,590 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,590 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,590 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,677 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,677 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,677 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,677 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,690 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,690 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,690 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,690 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,715 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:35,777 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,778 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,778 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,778 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,785 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,790 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,791 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,791 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,791 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,878 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,878 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,878 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,878 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,891 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,892 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,892 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,892 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,897 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,897 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,909 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,909 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,909 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:35,978 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,979 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,979 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,979 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:35,992 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,992 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,992 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:35,992 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,079 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,080 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,080 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,080 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,092 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,093 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,093 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,093 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,179 DEBUG [org.infinispan.test.fwk.TEST_PING] (Timer runner-1,test-NodeA-55522) Discovery protocol already stopped, so don't look for members 14:54:36,180 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,180 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,180 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,180 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,193 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,193 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,193 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,193 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,215 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:36,280 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,281 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,281 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,281 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,293 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,294 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,294 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,294 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,381 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,381 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,381 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,381 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,394 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,394 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,394 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,394 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,481 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,481 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,481 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,481 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,494 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,495 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,495 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,495 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,581 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,582 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,582 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,582 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,595 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,595 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,595 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,595 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,682 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,682 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,682 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,682 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,695 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,696 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,696 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,696 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,716 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:36,782 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,783 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,785 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,796 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,796 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,796 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,796 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,883 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,884 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,884 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,884 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,896 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,897 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,897 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,898 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,906 TRACE [org.jgroups.protocols.MERGE3] (jgroups-23,test-NodeC-10992) test-NodeC-10992: found no inconsistent views: [test-NodeC-10992|30]: [(1) test-NodeC-10992] 14:54:36,907 TRACE [org.jgroups.protocols.MERGE3] (jgroups-17,test-NodeA-55522) test-NodeA-55522: found no inconsistent views: [test-NodeC-10992|30]: [(1) test-NodeA-55522] 14:54:36,908 TRACE [org.jgroups.protocols.MERGE3] (jgroups-7,test-NodeB-18592) test-NodeB-18592: found no inconsistent views: [test-NodeC-10992|30]: [(1) test-NodeB-18592] 14:54:36,909 TRACE [org.jgroups.protocols.MERGE3] (jgroups-15,test-NodeD-25447) test-NodeD-25447: found no inconsistent views: [test-NodeC-10992|30]: [(1) test-NodeD-25447] 14:54:36,910 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,910 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:36,984 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,984 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,984 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,984 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:36,997 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,997 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,997 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:36,997 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,084 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,085 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,085 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,085 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,097 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,098 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,098 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,098 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,185 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,185 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,185 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,185 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,198 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,199 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,199 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,199 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,216 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:37,285 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,286 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,286 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,286 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,299 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,299 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,299 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,299 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,386 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,386 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,387 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,387 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,399 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,400 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,400 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,400 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,486 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,487 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,487 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,487 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,500 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,500 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,500 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,500 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,587 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,587 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,587 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,587 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,600 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,600 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,600 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,600 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,687 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,687 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,687 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,687 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,700 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,701 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,701 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,701 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,717 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:37,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,786 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,786 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,787 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,801 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,801 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,801 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,801 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,843 TRACE [org.jgroups.protocols.pbcast.STABLE] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending stable msg to test-NodeC-10992: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:37,843 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to test-NodeC-10992, src=test-NodeC-10992, headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:37,843 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: test-NodeC-10992, src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:37,843 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: test-NodeC-10992, src: test-NodeC-10992 (2 headers), size=79 bytes, flags=OOB|NO_RELIABILITY|INTERNAL], headers are STABLE: [STABLE_GOSSIP] view-id= [test-NodeC-10992|30], TP: [cluster_name=ISPN] 14:54:37,843 TRACE [org.jgroups.protocols.pbcast.STABLE] (jgroups-21,test-NodeC-10992) test-NodeC-10992: handling digest from test-NodeC-10992: mine: test-NodeC-10992: [-1], test-NodeA-55522: [-1], test-NodeB-18592: [-1], test-NodeD-25447: [-1] other: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] result: test-NodeC-10992: [18], test-NodeA-55522: [52], test-NodeB-18592: [0], test-NodeD-25447: [0] 14:54:37,888 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,888 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,888 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,888 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,898 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,898 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,898 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,901 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,901 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,901 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,901 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:37,910 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,910 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,910 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:37,937 DEBUG [org.infinispan.test.fwk.TEST_PING] (Timer runner-1,test-NodeB-18592) Discovery protocol already stopped, so don't look for members 14:54:37,988 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,989 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,989 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:37,989 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,001 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,002 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,002 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,002 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,089 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,089 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,089 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,089 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,102 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,102 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,102 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,102 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,189 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,190 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,190 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,190 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,202 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,203 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,203 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,203 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,217 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:38,290 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,291 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,291 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,291 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,303 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,304 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,304 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,304 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,391 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,391 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,391 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,391 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,403 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,404 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,404 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,404 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,491 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,491 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,491 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,491 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,504 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,504 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,504 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,504 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,591 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,592 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,592 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,592 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,604 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,605 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,605 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,605 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,692 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,692 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,692 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,692 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,705 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,705 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,705 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,705 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,717 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 14:54:38,787 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,787 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: sending msg to null, src=test-NodeB-18592, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,787 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: looping back message [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,787 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeB-18592) test-NodeB-18592: looping back message [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,787 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-21,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-6,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,788 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeB-18592 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,792 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,793 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,793 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,793 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,805 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,806 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,806 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,806 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,893 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,893 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,893 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,893 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,898 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: sending msg to null, src=test-NodeD-25447, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,898 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeD-25447) test-NodeD-25447: looping back message [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,899 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,899 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,899 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,899 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeD-25447 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,906 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,906 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:38,911 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,911 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: looping back message [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,911 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=INTERNAL], headers are FD_ALL: heartbeat, TP: [cluster_name=ISPN] 14:54:38,993 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,994 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,994 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:38,994 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,006 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,007 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,007 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,007 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,094 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,094 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,094 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,094 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,107 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,107 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,107 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,107 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,194 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeC-10992) test-NodeC-10992: sending msg to null, src=test-NodeC-10992, headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,195 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-17,test-NodeA-55522) test-NodeA-55522: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,195 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,195 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeC-10992 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=18], TP: [cluster_name=ISPN] 14:54:39,207 TRACE [org.jgroups.protocols.TCP_NIO2] (Timer runner-1,test-NodeA-55522) test-NodeA-55522: sending msg to null, src=test-NodeA-55522, headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,208 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-15,test-NodeD-25447) test-NodeD-25447: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,208 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-23,test-NodeC-10992) test-NodeC-10992: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,208 TRACE [org.jgroups.protocols.TCP_NIO2] (jgroups-7,test-NodeB-18592) test-NodeB-18592: received [dst: , src: test-NodeA-55522 (2 headers), size=0 bytes, flags=OOB|INTERNAL], headers are NAKACK2: [HIGHEST_SEQNO, seqno=52], TP: [cluster_name=ISPN] 14:54:39,218 TRACE [org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest] (TestNG) Local tx=[], remote tx=[GlobalTx:test-NodeA-55522:15], for cache test-NodeC-10992 [TestSuiteProgress] Test failed: org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest.testPrimaryOwnerIsolatedPartition[DIST_SYNC] 14:54:39,219 ERROR [org.infinispan.commons.test.TestSuiteProgress] (TestNG) Test failed: org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest.testPrimaryOwnerIsolatedPartition[DIST_SYNC] java.lang.AssertionError: There are pending transactions! at org.testng.AssertJUnit.fail(AssertJUnit.java:59) ~[testng-6.8.8.jar:?] at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24) ~[testng-6.8.8.jar:?] at org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:229) ~[test-classes/:?] at org.infinispan.test.AbstractInfinispanTest.eventually(AbstractInfinispanTest.java:525) ~[test-classes/:?] at org.infinispan.test.MultipleCacheManagersTest.assertNoTransactions(MultipleCacheManagersTest.java:806) ~[test-classes/:?] at org.infinispan.partitionhandling.BaseTxPartitionAndMergeTest.finalAsserts(BaseTxPartitionAndMergeTest.java:98) ~[test-classes/:?] at org.infinispan.partitionhandling.BaseOptimisticTxPartitionAndMergeTest.doTest(BaseOptimisticTxPartitionAndMergeTest.java:77) ~[test-classes/:?] at org.infinispan.partitionhandling.OptimisticTxPartitionAndMergeDuringPrepareTest.testPrimaryOwnerIsolatedPartition(OptimisticTxPartitionAndMergeDuringPrepareTest.java:41) ~[test-classes/:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_77] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_77] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_77] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_77] at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84) ~[testng-6.8.8.jar:?] at org.testng.internal.Invoker.invokeMethod(Invoker.java:714) [testng-6.8.8.jar:?] at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901) [testng-6.8.8.jar:?] at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231) [testng-6.8.8.jar:?] at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127) [testng-6.8.8.jar:?] at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111) [testng-6.8.8.jar:?]