2011-09-14 12:58:00,148 TRACE (testng-TopologyInfoBroadcastNoRehashTest) [org.infinispan.test.fwk.TestCacheManagerFactory] Adding DCM (null) for method: 'org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.createCacheManagers(TopologyInfoBroadcastTest.java:49)' 2011-09-14 12:58:00,181 TRACE (testng-TopologyInfoBroadcastNoRehashTest) [org.infinispan.test.fwk.TestCacheManagerFactory] Adding DCM (null) for method: 'org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.createCacheManagers(TopologyInfoBroadcastTest.java:49)' 2011-09-14 12:58:00,193 TRACE (testng-TopologyInfoBroadcastNoRehashTest) [org.infinispan.test.fwk.TestCacheManagerFactory] Adding DCM (null) for method: 'org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.createCacheManagers(TopologyInfoBroadcastTest.java:49)' 2011-09-14 12:59:59,169 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest] Creating cache managers 2011-09-14 12:59:59,172 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.manager.DefaultCacheManager] Started cache manager Infinispan-Cluster on null 2011-09-14 12:59:59,172 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TestCacheManagerFactory] Adding DCM (null) for method: 'org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.createCacheManagers(TopologyInfoBroadcastTest.java:49)' 2011-09-14 12:59:59,175 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.manager.DefaultCacheManager] Started cache manager Infinispan-Cluster on null 2011-09-14 12:59:59,175 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TestCacheManagerFactory] Adding DCM (null) for method: 'org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.createCacheManagers(TopologyInfoBroadcastTest.java:49)' 2011-09-14 12:59:59,178 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.manager.DefaultCacheManager] Started cache manager Infinispan-Cluster on null 2011-09-14 12:59:59,178 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TestCacheManagerFactory] Adding DCM (null) for method: 'org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.createCacheManagers(TopologyInfoBroadcastTest.java:49)' 2011-09-14 12:59:59,178 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest] Here it starts 2011-09-14 12:59:59,207 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000078: Starting JGroups Channel 2011-09-14 12:59:59,221 INFO (testng-TopologyInfoBroadcastTest) [org.jgroups.JChannel] JGroups version: 2.12.1.3.Final 2011-09-14 12:59:59,229 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] changed role to org.jgroups.protocols.pbcast.ClientGmsImpl 2011-09-14 12:59:59,257 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.stack.Configurator] set property TCP.diagnostics_addr to default value /224.0.75.75 2011-09-14 12:59:59,264 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.FRAG2] received CONFIG event: {bind_addr=/127.0.0.1} 2011-09-14 12:59:59,266 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] address=TopologyInfoBroadcastTest-NodeA-20211(s0), cluster=Infinispan-Cluster, physical address=127.0.0.1:8300 2011-09-14 12:59:59,276 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {} 2011-09-14 12:59:59,281 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Add discovery for TopologyInfoBroadcastTest-NodeA-20211(s0) to cache. The cache now contains: {TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,282 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 12:59:59,282 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] discovery took 6 ms: responses: 0 total (0 servers (0 coord), 0 clients) 2011-09-14 12:59:59,282 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] initial_mbrs are [] 2011-09-14 12:59:59,282 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] no initial members discovered: creating group as first member 2011-09-14 12:59:59,282 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.NAKACK] [setDigest()] existing digest: [] new digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 0 (0)] resulting digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 0 (0)] 2011-09-14 12:59:59,283 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|0] [TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,283 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 400KB (1 members) 2011-09-14 12:59:59,283 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|0] [TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,283 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|0] [TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,283 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): 2011-09-14 12:59:59,307 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] created group (first member). My view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|0], impl is org.jgroups.protocols.pbcast.CoordGmsImpl 2011-09-14 12:59:59,307 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000079: Cache local address is TopologyInfoBroadcastTest-NodeA-20211(s0), physical addresses are [127.0.0.1:8300] 2011-09-14 12:59:59,307 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] Waiting on view being accepted 2011-09-14 12:59:59,330 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.xa.TransactionFactory] Setting factory enum to NODLD_NORECOVERY_XA 2011-09-14 12:59:59,330 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 6 2011-09-14 12:59:59,330 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is: >> org.infinispan.interceptors.InvocationContextInterceptor >> org.infinispan.interceptors.DistTxInterceptor >> org.infinispan.interceptors.NotificationInterceptor >> org.infinispan.interceptors.DistLockingInterceptor >> org.infinispan.interceptors.DistributionInterceptor >> org.infinispan.interceptors.CallInterceptor 2011-09-14 12:59:59,330 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.DistributionManagerImpl] starting distribution manager on TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,330 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Starting distribution manager on TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,331 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,331 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,331 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 0 [TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,332 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,332 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,334 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeA-20211(s0) joining the cluster, broadcasting join request. 2011-09-14 12:59:59,335 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.rpc.RpcManagerImpl] We're the only member in the cluster; Don't invoke remotely. 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 0, confirmed members {TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 12:59:59,335 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 0 on node: TopologyInfoBroadcastTest-NodeA-20211(s0). Before start, data container had 0 entries 2011-09-14 12:59:59,335 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)}, chNew = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rehash not enabled, so not pushing state 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeA-20211(s0) finished pushing state for view 0, broadcasting push complete signal. 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 0, confirmed 1 of 1, confirmations map is {TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 12:59:59,335 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.rpc.RpcManagerImpl] We're the only member in the cluster; Don't invoke remotely. 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 0, received confirmations {TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 12:59:59,335 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 12:59:59,335 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 12:59:59,335 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeA-20211(s0) completed rehash for view 0 in 0 milliseconds! 2011-09-14 12:59:59,335 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Started cache ___defaultcache on TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,369 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000078: Starting JGroups Channel 2011-09-14 12:59:59,370 INFO (testng-TopologyInfoBroadcastTest) [org.jgroups.JChannel] JGroups version: 2.12.1.3.Final 2011-09-14 12:59:59,375 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] changed role to org.jgroups.protocols.pbcast.ClientGmsImpl 2011-09-14 12:59:59,385 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.stack.Configurator] set property TCP.diagnostics_addr to default value /224.0.75.75 2011-09-14 12:59:59,393 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.FRAG2] received CONFIG event: {bind_addr=/127.0.0.1} 2011-09-14 12:59:59,396 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] address=TopologyInfoBroadcastTest-NodeB-32215(s1), cluster=Infinispan-Cluster, physical address=127.0.0.1:8301 2011-09-14 12:59:59,397 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,397 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Add discovery for TopologyInfoBroadcastTest-NodeB-32215(s1) to cache. The cache now contains: {TopologyInfoBroadcastTest-NodeB-32215(s1)=TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,397 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 12:59:59,397 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,397 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeB-32215(s1) with physical address 127.0.0.1:8301 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,397 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeA-20211(s0), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|0], is_server=true, is_coord=true, logical_name=TopologyInfoBroadcastTest-NodeA-20211, physical_addrs=127.0.0.1:8300 2011-09-14 12:59:59,398 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] discovery took 0 ms: responses: 1 total (1 servers (1 coord), 0 clients) 2011-09-14 12:59:59,398 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] initial_mbrs are [own_addr=TopologyInfoBroadcastTest-NodeA-20211(s0), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|0], is_server=true, is_coord=true, logical_name=TopologyInfoBroadcastTest-NodeA-20211, physical_addrs=127.0.0.1:8300] 2011-09-14 12:59:59,398 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] election results: {TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,398 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending handleJoin(TopologyInfoBroadcastTest-NodeB-32215(s1)) to TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,459 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] new=[TopologyInfoBroadcastTest-NodeB-32215(s1)], suspected=[], leaving=[], new view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,459 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] suspending message garbage collection 2011-09-14 12:59:59,459 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] resume task started, max_suspend_time=33000 2011-09-14 12:59:59,462 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.NAKACK] [setDigest()] existing digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 1 (1)] new digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 0 (0)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 0] resulting digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 1 (1)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 0 (0)] 2011-09-14 12:59:59,462 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,462 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 800KB (2 members) 2011-09-14 12:59:59,472 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,472 INFO (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,472 TRACE (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 1 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,473 TRACE (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received new view 1, confirmed 0 of 2 2011-09-14 12:59:59,477 TRACE (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Updated confirmed members are {TopologyInfoBroadcastTest-NodeA-20211(s0)=0}, push confirmations map is {TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 12:59:59,478 TRACE (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,478 TRACE (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,478 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 1, confirmed members {TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 12:59:59,483 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.NAKACK] [setDigest()] existing digest: [] new digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 1 (1)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 0] resulting digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 1 (1)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 0 (0)] 2011-09-14 12:59:59,483 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] [TopologyInfoBroadcastTest-NodeB-32215(s1)]: JoinRsp=[TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] [size=2] 2011-09-14 12:59:59,483 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] new_view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,483 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,483 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 800KB (2 members) 2011-09-14 12:59:59,483 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,483 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|1] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,483 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): 2011-09-14 12:59:59,484 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000079: Cache local address is TopologyInfoBroadcastTest-NodeB-32215(s1), physical addresses are [127.0.0.1:8301] 2011-09-14 12:59:59,484 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] Waiting on view being accepted 2011-09-14 12:59:59,487 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection 2011-09-14 12:59:59,494 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.xa.TransactionFactory] Setting factory enum to NODLD_NORECOVERY_XA 2011-09-14 12:59:59,494 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 6 2011-09-14 12:59:59,494 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is: >> org.infinispan.interceptors.InvocationContextInterceptor >> org.infinispan.interceptors.DistTxInterceptor >> org.infinispan.interceptors.NotificationInterceptor >> org.infinispan.interceptors.DistLockingInterceptor >> org.infinispan.interceptors.DistributionInterceptor >> org.infinispan.interceptors.CallInterceptor 2011-09-14 12:59:59,494 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.DistributionManagerImpl] starting distribution manager on TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,494 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Starting distribution manager on TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,495 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,495 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,495 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 1 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,496 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,496 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,498 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeB-32215(s1) joining the cluster, broadcasting join request. 2011-09-14 12:59:59,499 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,499 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A} to addresses null 2011-09-14 12:59:59,499 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,559 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A} [sender=TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,561 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A} 2011-09-14 12:59:59,562 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,562 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 1, confirmed members {TopologyInfoBroadcastTest-NodeB-32215(s1)=1} 2011-09-14 12:59:59,561 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 12:59:59,576 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 1 on node: TopologyInfoBroadcastTest-NodeA-20211(s0). Before start, data container had 0 entries 2011-09-14 12:59:59,576 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 12:59:59,576 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,576 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 12:59:59,576 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 12:59:59,576 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)}, chNew = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,577 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] No cache store or cache store is shared, not rebalancing stored keys 2011-09-14 12:59:59,577 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferTask] Node finished pushing data for rehash 1. 2011-09-14 12:59:59,577 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeA-20211(s0) finished pushing state for view 1, broadcasting push complete signal. 2011-09-14 12:59:59,577 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 1, confirmed 1 of 2, confirmations map is {TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,577 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=1, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,577 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=1, state=N/A} to addresses null 2011-09-14 12:59:59,577 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,577 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=1, state=N/A} [sender=TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,577 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=1, state=N/A} 2011-09-14 12:59:59,578 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 1, confirmed 1 of 2, confirmations map is {TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 12:59:59,581 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 1 on node: TopologyInfoBroadcastTest-NodeB-32215(s1). Before start, data container had 0 entries 2011-09-14 12:59:59,581 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)}, chNew = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rehash not enabled, so not pushing state 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeB-32215(s1) finished pushing state for view 1, broadcasting push complete signal. 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeB-32215(s1) for view 1, confirmed 2 of 2, confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,583 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A} to addresses null 2011-09-14 12:59:59,583 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,581 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,583 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 1, received confirmations {TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,583 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A} [sender=TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,585 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=1, state=N/A} 2011-09-14 12:59:59,586 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeB-32215(s1) for view 1, confirmed 2 of 2, confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,591 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 12:59:59,591 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 12:59:59,591 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeA-20211(s0) completed rehash for view 1 in 15 milliseconds! 2011-09-14 12:59:59,592 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,592 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 1, received confirmations {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,592 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 12:59:59,592 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 12:59:59,592 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeB-32215(s1) completed rehash for view 1 in 11 milliseconds! 2011-09-14 12:59:59,592 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Started cache ___defaultcache on TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,615 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000078: Starting JGroups Channel 2011-09-14 12:59:59,629 INFO (testng-TopologyInfoBroadcastTest) [org.jgroups.JChannel] JGroups version: 2.12.1.3.Final 2011-09-14 12:59:59,634 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] changed role to org.jgroups.protocols.pbcast.ClientGmsImpl 2011-09-14 12:59:59,672 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.stack.Configurator] set property TCP.diagnostics_addr to default value /224.0.75.75 2011-09-14 12:59:59,696 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.FRAG2] received CONFIG event: {bind_addr=/127.0.0.1} 2011-09-14 12:59:59,698 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] address=TopologyInfoBroadcastTest-NodeC-36650(s2), cluster=Infinispan-Cluster, physical address=127.0.0.1:8302 2011-09-14 12:59:59,699 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeB-32215(s1)=TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,699 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Add discovery for TopologyInfoBroadcastTest-NodeC-36650(s2) to cache. The cache now contains: {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeB-32215(s1)=TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,699 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 12:59:59,699 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeB-32215(s1) with physical address 127.0.0.1:8301 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 12:59:59,716 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,716 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeB-32215(s1), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|1], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeB-32215, physical_addrs=127.0.0.1:8301 2011-09-14 12:59:59,717 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 12:59:59,717 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,717 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeA-20211(s0), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|1], is_server=true, is_coord=true, logical_name=TopologyInfoBroadcastTest-NodeA-20211, physical_addrs=127.0.0.1:8300 2011-09-14 12:59:59,717 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.TEST_PING] discovery took 18 ms: responses: 2 total (2 servers (1 coord), 0 clients) 2011-09-14 12:59:59,717 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] initial_mbrs are [own_addr=TopologyInfoBroadcastTest-NodeB-32215(s1), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|1], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeB-32215, physical_addrs=127.0.0.1:8301, own_addr=TopologyInfoBroadcastTest-NodeA-20211(s0), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|1], is_server=true, is_coord=true, logical_name=TopologyInfoBroadcastTest-NodeA-20211, physical_addrs=127.0.0.1:8300] 2011-09-14 12:59:59,717 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] election results: {TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,717 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending handleJoin(TopologyInfoBroadcastTest-NodeC-36650(s2)) to TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,737 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] new=[TopologyInfoBroadcastTest-NodeC-36650(s2)], suspected=[], leaving=[], new view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,737 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] suspending message garbage collection 2011-09-14 12:59:59,737 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] resume task started, max_suspend_time=33000 2011-09-14 12:59:59,737 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.NAKACK] [setDigest()] existing digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 3 (3)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] new digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 0], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 2 (2)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] resulting digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 0 (0)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 3 (3)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] 2011-09-14 12:59:59,737 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,738 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 1.2MB (3 members) 2011-09-14 12:59:59,738 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,738 INFO (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,738 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 2 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,738 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received new view 2, confirmed 0 of 3 2011-09-14 12:59:59,738 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Updated confirmed members are {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=0}, push confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,741 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,741 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,742 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 2, confirmed members {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 12:59:59,769 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.NAKACK] [setDigest()] existing digest: TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 3 (3)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] new digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 0], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 2 (2)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] resulting digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 0 (0)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 3 (3)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] 2011-09-14 12:59:59,806 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,807 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 1.2MB (3 members) 2011-09-14 12:59:59,807 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,807 INFO (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,807 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 2 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,807 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Received new view 2, confirmed 0 of 3 2011-09-14 12:59:59,807 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Updated confirmed members are {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=1}, push confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,808 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,808 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,809 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.NAKACK] [setDigest()] existing digest: [] new digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 0], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 3 (3)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] resulting digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 0 (0)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 3 (3)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 2 (2)] 2011-09-14 12:59:59,809 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] [TopologyInfoBroadcastTest-NodeC-36650(s2)]: JoinRsp=[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] [size=3] 2011-09-14 12:59:59,809 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] new_view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,809 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeC-36650(s2): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,810 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 1.2MB (3 members) 2011-09-14 12:59:59,810 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,810 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,810 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeC-36650(s2): 2011-09-14 12:59:59,810 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000079: Cache local address is TopologyInfoBroadcastTest-NodeC-36650(s2), physical addresses are [127.0.0.1:8302] 2011-09-14 12:59:59,810 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection 2011-09-14 12:59:59,808 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 2, confirmed members {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=1} 2011-09-14 12:59:59,811 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] Waiting on view being accepted 2011-09-14 12:59:59,824 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.xa.TransactionFactory] Setting factory enum to NODLD_NORECOVERY_XA 2011-09-14 12:59:59,824 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InterceptorChain] Interceptor chain size: 6 2011-09-14 12:59:59,824 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InterceptorChain] Interceptor chain is: >> org.infinispan.interceptors.InvocationContextInterceptor >> org.infinispan.interceptors.DistTxInterceptor >> org.infinispan.interceptors.NotificationInterceptor >> org.infinispan.interceptors.DistLockingInterceptor >> org.infinispan.interceptors.DistributionInterceptor >> org.infinispan.interceptors.CallInterceptor 2011-09-14 12:59:59,824 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.DistributionManagerImpl] starting distribution manager on TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 12:59:59,824 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Starting distribution manager on TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 12:59:59,825 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,825 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,825 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 2 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,825 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,825 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,827 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeC-36650(s2) joining the cluster, broadcasting join request. 2011-09-14 12:59:59,827 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,827 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} to addresses null 2011-09-14 12:59:59,827 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,828 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,828 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} 2011-09-14 12:59:59,828 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 12:59:59,829 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 2 on node: TopologyInfoBroadcastTest-NodeA-20211(s0). Before start, data container had 0 entries 2011-09-14 12:59:59,829 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 12:59:59,829 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,829 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 12:59:59,832 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 12:59:59,834 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)}, chNew = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,835 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] No cache store or cache store is shared, not rebalancing stored keys 2011-09-14 12:59:59,835 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferTask] Node finished pushing data for rehash 2. 2011-09-14 12:59:59,835 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeA-20211(s0) finished pushing state for view 2, broadcasting push complete signal. 2011-09-14 12:59:59,835 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 2, confirmed 1 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,835 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=2, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,835 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=2, state=N/A} to addresses null 2011-09-14 12:59:59,835 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,836 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,836 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=2, state=N/A} 2011-09-14 12:59:59,836 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,836 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=2, state=N/A} 2011-09-14 12:59:59,836 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 2, confirmed 1 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,837 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,837 TRACE (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=REQUEST_JOIN, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} 2011-09-14 12:59:59,836 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 2, confirmed 1 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,840 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 12:59:59,840 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 2 on node: TopologyInfoBroadcastTest-NodeB-32215(s1). Before start, data container had 0 entries 2011-09-14 12:59:59,840 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 12:59:59,840 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeC-36650(s2), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] [sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,840 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 2, received confirmations {TopologyInfoBroadcastTest-NodeB-32215(s1)=1, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,840 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,841 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 12:59:59,843 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 12:59:59,843 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)}, chNew = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,844 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] No cache store or cache store is shared, not rebalancing stored keys 2011-09-14 12:59:59,844 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.BaseStateTransferTask] Node finished pushing data for rehash 2. 2011-09-14 12:59:59,845 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeB-32215(s1) finished pushing state for view 2, broadcasting push complete signal. 2011-09-14 12:59:59,845 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeB-32215(s1) for view 2, confirmed 2 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,845 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=2, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,845 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=2, state=N/A} to addresses null 2011-09-14 12:59:59,845 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,846 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,846 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=2, state=N/A} 2011-09-14 12:59:59,846 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeB-32215(s1) for view 2, confirmed 2 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,854 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,854 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] [sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,854 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 2, confirmed members {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,854 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeB-32215(s1), viewId=2, state=N/A} 2011-09-14 12:59:59,855 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeB-32215(s1) for view 2, confirmed 2 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,855 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 12:59:59,855 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 2 on node: TopologyInfoBroadcastTest-NodeC-36650(s2). Before start, data container had 0 entries 2011-09-14 12:59:59,855 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)}, chNew = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rehash not enabled, so not pushing state 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeC-36650(s2) finished pushing state for view 2, broadcasting push complete signal. 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeC-36650(s2) for view 2, confirmed 3 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} to addresses null 2011-09-14 12:59:59,856 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 12:59:59,857 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,857 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} 2011-09-14 12:59:59,857 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeC-36650(s2) for view 2, confirmed 3 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,857 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeC-36650(s2), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] [sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,860 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 2, received confirmations {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,860 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 12:59:59,860 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 12:59:59,860 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeB-32215(s1) completed rehash for view 2 in 20 milliseconds! 2011-09-14 12:59:59,857 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} [sender=TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,861 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=2, state=N/A} 2011-09-14 12:59:59,861 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeC-36650(s2) for view 2, confirmed 3 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,861 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 12:59:59,861 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 12:59:59,861 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] [sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,861 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 2, received confirmations {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,861 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 12:59:59,861 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 12:59:59,861 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeC-36650(s2) completed rehash for view 2 in 6 milliseconds! 2011-09-14 12:59:59,862 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Started cache ___defaultcache on TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 12:59:59,861 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeA-20211(s0) completed rehash for view 2 in 32 milliseconds! 2011-09-14 12:59:59,962 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Node TopologyInfoBroadcastTest-NodeC-36650(s2) finished join task. 2011-09-14 12:59:59,962 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Node TopologyInfoBroadcastTest-NodeA-20211(s0) finished join task. 2011-09-14 12:59:59,962 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Node TopologyInfoBroadcastTest-NodeB-32215(s1) finished join task. 2011-09-14 12:59:59,962 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest] Here it ends 2011-09-14 12:59:59,962 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Starting test testIsReplicated(org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest) 2011-09-14 12:59:59,963 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest] *** Test method complete; clearing contents on all caches. 2011-09-14 12:59:59,963 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cleaning data for cache '___defaultcache' on a cache manager at address TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 12:59:59,963 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerBefore == [] 2011-09-14 12:59:59,963 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerAfter == [] 2011-09-14 12:59:59,963 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cleaning data for cache '___defaultcache' on a cache manager at address TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,963 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerBefore == [] 2011-09-14 12:59:59,963 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerAfter == [] 2011-09-14 12:59:59,964 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cleaning data for cache '___defaultcache' on a cache manager at address TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 12:59:59,964 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerBefore == [] 2011-09-14 12:59:59,964 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerAfter == [] 2011-09-14 12:59:59,964 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Test succeeded testIsReplicated(org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest). 2011-09-14 12:59:59,965 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Starting test testNodeLeaves(org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest) 2011-09-14 12:59:59,965 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command EntrySetCommand{set=[]} and InvocationContext [NonTxInvocationContext{flags=null}] 2011-09-14 12:59:59,965 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.CallInterceptor] Executing command: EntrySetCommand{set=[]}. 2011-09-14 12:59:59,965 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cache contents before stopping: [] 2011-09-14 12:59:59,965 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Stopping cache ___defaultcache on TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,965 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.TransactionTable] Wait for on-going transactions to finish for 30 seconds. 2011-09-14 12:59:59,965 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.TransactionTable] All transactions terminated 2011-09-14 12:59:59,971 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.manager.DefaultCacheManager] Stopping cache manager Infinispan-Cluster on TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,971 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Stopping cache ___defaultcache on TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,971 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000080: Disconnecting and closing JGroups Channel 2011-09-14 12:59:59,971 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending LEAVE request to TopologyInfoBroadcastTest-NodeA-20211(s0) (local_addr=TopologyInfoBroadcastTest-NodeB-32215(s1)) 2011-09-14 12:59:59,971 DEBUG (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] received LEAVE_REQ for TopologyInfoBroadcastTest-NodeB-32215(s1) from TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 12:59:59,971 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] new=[], suspected=[], leaving=[TopologyInfoBroadcastTest-NodeB-32215(s1)], new view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,972 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,972 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.NAKACK] removed TopologyInfoBroadcastTest-NodeB-32215(s1) from xmit_table (not member anymore) 2011-09-14 12:59:59,972 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 800KB (2 members) 2011-09-14 12:59:59,972 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,972 INFO (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,973 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Saw 1 leavers - kicking off a lock breaking task 2011-09-14 12:59:59,975 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 3 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,976 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received new view 3, confirmed 0 of 2 2011-09-14 12:59:59,976 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Updated confirmed members are {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=0}, push confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 12:59:59,977 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,977 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 3, confirmed members {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 12:59:59,977 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 3 on node: TopologyInfoBroadcastTest-NodeA-20211(s0). Before start, data container had 0 entries 2011-09-14 12:59:59,977 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)}, chNew = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] No cache store or cache store is shared, not rebalancing stored keys 2011-09-14 12:59:59,977 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferTask] Node finished pushing data for rehash 3. 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeA-20211(s0) finished pushing state for view 3, broadcasting push complete signal. 2011-09-14 12:59:59,977 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 3, confirmed 1 of 2, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 12:59:59,978 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=3, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 12:59:59,978 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=3, state=N/A} to addresses null 2011-09-14 12:59:59,978 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 12:59:59,979 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=3, state=N/A} [sender=TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 12:59:59,979 TRACE (LockBreakingService,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) [TopologyInfoBroadcastTest-NodeB-32215(s1)] who have left the cluster. 2011-09-14 12:59:59,979 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=3, state=N/A} 2011-09-14 12:59:59,979 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received new view 3, confirmed 0 of 2147483647 2011-09-14 12:59:59,979 TRACE (LockBreakingService,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers 2011-09-14 12:59:59,979 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 3, confirmed 1 of 2147483647, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 12:59:59,980 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeC-36650(s2), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 12:59:59,980 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 3, received confirmations {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 13:00:00,003 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeC-36650(s2): view is [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:00,003 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.NAKACK] removed TopologyInfoBroadcastTest-NodeB-32215(s1) from xmit_table (not member anymore) 2011-09-14 13:00:00,004 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 800KB (2 members) 2011-09-14 13:00:00,004 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:00,004 INFO (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:00,004 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Saw 1 leavers - kicking off a lock breaking task 2011-09-14 13:00:00,005 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 3 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:00,005 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received proper members list for cluster view 3 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:00,006 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Updated confirmed members are {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2}, push confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 13:00:00,006 TRACE (LockBreakingService,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) [TopologyInfoBroadcastTest-NodeB-32215(s1)] who have left the cluster. 2011-09-14 13:00:00,006 TRACE (LockBreakingService,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers 2011-09-14 13:00:00,006 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:00,006 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:00,007 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 3, confirmed members {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 13:00:00,009 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 13:00:00,009 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 3 on node: TopologyInfoBroadcastTest-NodeC-36650(s2). Before start, data container had 0 entries 2011-09-14 13:00:00,009 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 13:00:00,009 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:00,009 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 13:00:00,009 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 13:00:00,009 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)}, chNew = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:00,010 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] No cache store or cache store is shared, not rebalancing stored keys 2011-09-14 13:00:00,010 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferTask] Node finished pushing data for rehash 3. 2011-09-14 13:00:00,010 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeC-36650(s2) finished pushing state for view 3, broadcasting push complete signal. 2011-09-14 13:00:00,010 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeC-36650(s2) for view 3, confirmed 2 of 2, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=3, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 13:00:00,010 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=3, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 13:00:00,010 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=3, state=N/A} to addresses null 2011-09-14 13:00:00,011 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 13:00:00,013 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=3, state=N/A} [sender=TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:00,014 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=3, state=N/A} 2011-09-14 13:00:00,014 TRACE (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeC-36650(s2) for view 3, confirmed 2 of 2, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=3, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 13:00:00,014 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 13:00:00,014 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 13:00:00,014 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeA-20211(s0) completed rehash for view 3 in 37 milliseconds! 2011-09-14 13:00:00,014 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2011-09-14 13:00:00,014 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm pushing state for view 3, received confirmations {TopologyInfoBroadcastTest-NodeC-36650(s2)=3, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 13:00:00,014 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Push confirmed by all cluster members 2011-09-14 13:00:00,014 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 13:00:00,014 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Node TopologyInfoBroadcastTest-NodeC-36650(s2) completed rehash for view 3 in 5 milliseconds! 2011-09-14 13:00:04,971 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending LEAVE request to TopologyInfoBroadcastTest-NodeA-20211(s0) (local_addr=TopologyInfoBroadcastTest-NodeB-32215(s1)) 2011-09-14 13:00:04,978 DEBUG (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] received LEAVE_REQ for TopologyInfoBroadcastTest-NodeB-32215(s1) from TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 13:00:09,394 WARN (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.NAKACK] TopologyInfoBroadcastTest-NodeA-20211(s0): dropped message from TopologyInfoBroadcastTest-NodeB-32215(s1) (not in table [TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)]), view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:09,414 WARN (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.NAKACK] TopologyInfoBroadcastTest-NodeC-36650(s2): dropped message from TopologyInfoBroadcastTest-NodeB-32215(s1) (not in table [TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)]), view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:09,976 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending LEAVE request to TopologyInfoBroadcastTest-NodeA-20211(s0) (local_addr=TopologyInfoBroadcastTest-NodeB-32215(s1)) 2011-09-14 13:00:09,976 DEBUG (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] received LEAVE_REQ for TopologyInfoBroadcastTest-NodeB-32215(s1) from TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeB-32215(s1)=TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeC-36650(s2), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|3], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeC-36650 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeB-32215(s1) with physical address 127.0.0.1:8301 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeB-32215(s1), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|2], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeB-32215 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 13:00:10,396 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] discovery took 1 ms: responses: 2 total (2 servers (0 coord), 0 clients) 2011-09-14 13:00:10,396 DEBUG (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.MERGE2] TopologyInfoBroadcastTest-NodeA-20211(s0) found different views : [TopologyInfoBroadcastTest-NodeA-20211(s0)|3], [TopologyInfoBroadcastTest-NodeA-20211(s0)|2]; sending up MERGE event with merge participants [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)]. Discovery results: [TopologyInfoBroadcastTest-NodeC-36650(s2)]: [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] [TopologyInfoBroadcastTest-NodeB-32215(s1)]: [TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] [TopologyInfoBroadcastTest-NodeA-20211(s0)]: [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,396 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] determining merge leader from [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 13:00:10,396 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] I (TopologyInfoBroadcastTest-NodeA-20211(s0)) will be the leader. Starting the merge task for [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 13:00:10,398 DEBUG (MergeTask,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): sending MERGE_REQ to [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 13:00:10,398 DEBUG (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] suspending message garbage collection 2011-09-14 13:00:10,398 DEBUG (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] resume task started, max_suspend_time=200000 2011-09-14 13:00:10,398 DEBUG (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): got merge request from TopologyInfoBroadcastTest-NodeA-20211(s0), merge_id=TopologyInfoBroadcastTest-NodeA-20211(s0)::3, mbrs=[TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,399 DEBUG (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.STABLE] suspending message garbage collection 2011-09-14 13:00:10,399 DEBUG (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.STABLE] resume task started, max_suspend_time=200000 2011-09-14 13:00:10,399 DEBUG (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): got merge request from TopologyInfoBroadcastTest-NodeA-20211(s0), merge_id=TopologyInfoBroadcastTest-NodeA-20211(s0)::3, mbrs=[TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 13:00:10,400 WARN (OOB-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.NAKACK] TopologyInfoBroadcastTest-NodeA-20211(s0): dropped message from TopologyInfoBroadcastTest-NodeB-32215(s1) (not in table [TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)]), view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,402 WARN (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.NAKACK] TopologyInfoBroadcastTest-NodeC-36650(s2): dropped message from TopologyInfoBroadcastTest-NodeB-32215(s1) (not in table [TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)]), view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,402 DEBUG (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): fetched all digests for [TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 13:00:10,403 DEBUG (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): fetched all digests for [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,403 DEBUG (OOB-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): sending merge response=GmsHeader[MERGE_RSP]: view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)], digest=TopologyInfoBroadcastTest-NodeC-36650(s2): [2 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [6 : 7 (8)], merge_id=TopologyInfoBroadcastTest-NodeA-20211(s0)::3 2011-09-14 13:00:10,404 DEBUG (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): got merge response from TopologyInfoBroadcastTest-NodeA-20211(s0), merge_id=TopologyInfoBroadcastTest-NodeA-20211(s0)::3, merge data is sender=TopologyInfoBroadcastTest-NodeA-20211(s0), view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)], digest=TopologyInfoBroadcastTest-NodeC-36650(s2): [2 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [6 : 7 (8)] 2011-09-14 13:00:10,402 DEBUG (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): sending merge response=GmsHeader[MERGE_RSP]: view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], digest=TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 2 (2)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 4 (8)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)], merge_id=TopologyInfoBroadcastTest-NodeA-20211(s0)::3 2011-09-14 13:00:10,405 DEBUG (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): got merge response from TopologyInfoBroadcastTest-NodeB-32215(s1), merge_id=TopologyInfoBroadcastTest-NodeA-20211(s0)::3, merge data is sender=TopologyInfoBroadcastTest-NodeB-32215(s1), view=[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], digest=TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 2 (2)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 4 (8)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)] 2011-09-14 13:00:10,406 DEBUG (MergeTask,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): collected 2 merge response(s) in 8 ms 2011-09-14 13:00:10,406 DEBUG (MergeTask,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] Merge leader TopologyInfoBroadcastTest-NodeA-20211(s0): consolidated view=MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] consolidated digest=TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 7 (8)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)] 2011-09-14 13:00:10,406 DEBUG (MergeTask,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): sending merge view [TopologyInfoBroadcastTest-NodeA-20211(s0)|4] to coordinators [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 13:00:10,407 DEBUG (MergeTask,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): merge leader completed merge task 2011-09-14 13:00:10,415 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeB-32215(s1)=TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:10,416 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 13:00:10,416 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeB-32215(s1) with physical address 127.0.0.1:8301 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:00:10,416 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeB-32215(s1) 2011-09-14 13:00:10,417 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeB-32215(s1), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|4], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeB-32215 2011-09-14 13:00:10,417 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:00:10,417 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:00:10,417 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeA-20211(s0), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|4], is_server=true, is_coord=true, logical_name=TopologyInfoBroadcastTest-NodeA-20211 2011-09-14 13:00:10,417 TRACE (Timer-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.test.fwk.TEST_PING] discovery took 2 ms: responses: 2 total (2 servers (1 coord), 0 clients) 2011-09-14 13:00:10,411 DEBUG (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.NAKACK] [mergeDigest()] existing digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [2 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [6 : 9 (9)] new digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 7 (8)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)] resulting digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [2 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [6 : 9 (9)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)] 2011-09-14 13:00:10,410 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.NAKACK] [mergeDigest()] existing digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 2 (2)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 4 (8)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 6 (6)] new digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 7 (8)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)] resulting digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 7 (7)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 6 (6)] 2011-09-14 13:00:10,417 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): view is MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,418 DEBUG (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): view is MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,418 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 1.2MB (3 members) 2011-09-14 13:00:10,418 DEBUG (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,418 INFO (Incoming-1,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000093: Received new, MERGED cluster view: MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,419 DEBUG (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 1.2MB (3 members) 2011-09-14 13:00:10,419 DEBUG (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,419 INFO (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000093: Received new, MERGED cluster view: MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,419 TRACE (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 4 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,421 TRACE (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received new view 4, confirmed 0 of 3 2011-09-14 13:00:10,423 TRACE (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Updated confirmed members are {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=4, TopologyInfoBroadcastTest-NodeA-20211(s0)=0}, push confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=3, TopologyInfoBroadcastTest-NodeA-20211(s0)=3} 2011-09-14 13:00:10,424 TRACE (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,424 TRACE (Incoming-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 4, confirmed members {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=4, TopologyInfoBroadcastTest-NodeA-20211(s0)=0} 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 13:00:10,426 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 4 on node: TopologyInfoBroadcastTest-NodeA-20211(s0). Before start, data container had 0 entries 2011-09-14 13:00:10,426 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)}, chNew = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.DistributedStateTransferTask] No cache store or cache store is shared, not rebalancing stored keys 2011-09-14 13:00:10,426 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferTask] Node finished pushing data for rehash 4. 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeA-20211(s0) finished pushing state for view 4, broadcasting push complete signal. 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 4, confirmed 1 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=3, TopologyInfoBroadcastTest-NodeA-20211(s0)=4} 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=4, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=4, state=N/A} to addresses null 2011-09-14 13:00:10,426 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,427 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=4, state=N/A} [sender=TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 13:00:10,437 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=4, state=N/A} 2011-09-14 13:00:10,437 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received new view 4, confirmed 0 of 2147483647 2011-09-14 13:00:10,427 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=4, state=N/A} [sender=TopologyInfoBroadcastTest-NodeA-20211(s0)] 2011-09-14 13:00:10,437 TRACE (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeA-20211(s0) for view 4, confirmed 1 of 2147483647, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=3, TopologyInfoBroadcastTest-NodeA-20211(s0)=4} 2011-09-14 13:00:10,437 INFO (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.InboundInvocationHandlerImpl] ISPN000067: Will try and wait for the cache ___defaultcache to start 2011-09-14 13:00:10,438 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.NAKACK] [mergeDigest()] existing digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [2 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [6 : 10 (10)] new digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [0 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [0 : 7 (8)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)] resulting digest: TopologyInfoBroadcastTest-NodeC-36650(s2): [2 : 5 (5)], TopologyInfoBroadcastTest-NodeA-20211(s0): [6 : 10 (10)], TopologyInfoBroadcastTest-NodeB-32215(s1): [0 : 4 (4)] 2011-09-14 13:00:10,438 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeC-36650(s2): view is MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,438 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 1.2MB (3 members) 2011-09-14 13:00:10,439 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,439 INFO (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000093: Received new, MERGED cluster view: MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:00:10,439 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Received new cluster view: 4 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,440 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received proper members list for cluster view 4 [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,440 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Updated confirmed members are {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=4, TopologyInfoBroadcastTest-NodeA-20211(s0)=2}, push confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=3, TopologyInfoBroadcastTest-NodeA-20211(s0)=4} 2011-09-14 13:00:10,440 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Positions are: {276694121=TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381=TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885=TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,441 TRACE (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.distribution.ch.TopologyAwareConsistentHash] Consistent hash initialized: TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Waiting for all the members of the cluster to confirm joining for view 4, confirmed members {TopologyInfoBroadcastTest-NodeC-36650(s2)=2, TopologyInfoBroadcastTest-NodeB-32215(s1)=4, TopologyInfoBroadcastTest-NodeA-20211(s0)=2} 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Join confirmed by all cluster members 2011-09-14 13:00:10,442 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Commencing rehash 4 on node: TopologyInfoBroadcastTest-NodeC-36650(s2). Before start, data container had 0 entries 2011-09-14 13:00:10,442 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.StateTransferLockImpl] Blocking new transactions 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.distribution.DistributionManagerImpl] Installing new consistent hash TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Unlocking keys for which we are no longer an owner 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.transaction.TransactionTable] Finished cleaning locks for keys that are no longer local 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] Rebalancing: chOld = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0)}, chNew = TopologyAwareConsistentHash {276694121: TopologyInfoBroadcastTest-NodeC-36650(s2), 1620908381: TopologyInfoBroadcastTest-NodeA-20211(s0), 1667808885: TopologyInfoBroadcastTest-NodeB-32215(s1)} 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.DistributedStateTransferTask] No cache store or cache store is shared, not rebalancing stored keys 2011-09-14 13:00:10,442 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferTask] Node finished pushing data for rehash 4. 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferManagerImpl] Node TopologyInfoBroadcastTest-NodeC-36650(s2) finished pushing state for view 4, broadcasting push complete signal. 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeC-36650(s2) for view 4, confirmed 2 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=4, TopologyInfoBroadcastTest-NodeA-20211(s0)=4} 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=4, state=N/A}, mode=SYNCHRONOUS, timeout=600000 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=4, state=N/A} to addresses null 2011-09-14 13:00:10,442 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 13:00:10,443 TRACE (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=4, state=N/A} [sender=TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,443 TRACE (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=4, state=N/A} 2011-09-14 13:00:10,443 TRACE (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.PushConfirmationsMap] Received push confirmation from TopologyInfoBroadcastTest-NodeC-36650(s2) for view 4, confirmed 2 of 3, confirmations map is {TopologyInfoBroadcastTest-NodeC-36650(s2)=4, TopologyInfoBroadcastTest-NodeA-20211(s0)=4} 2011-09-14 13:00:10,443 TRACE (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=4, state=N/A} [sender=TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:00:10,446 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection 2011-09-14 13:00:10,446 INFO (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.InboundInvocationHandlerImpl] ISPN000067: Will try and wait for the cache ___defaultcache to start 2011-09-14 13:00:11,041 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection 2011-09-14 13:00:14,983 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeB-32215(s1): 2011-09-14 13:00:15,021 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.TCP] closing sockets and stopping threads 2011-09-14 13:00:15,022 WARN (OOB-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Shutdown while handling command StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeA-20211(s0), viewId=4, state=N/A} 2011-09-14 13:00:15,022 WARN (OOB-5,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeB-32215(s1)) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Shutdown while handling command StateTransferControlCommand{cache=___defaultcache, type=PUSH_COMPLETED, sender=TopologyInfoBroadcastTest-NodeC-36650(s2), viewId=4, state=N/A} 2011-09-14 13:00:15,024 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher 2011-09-14 13:00:28,133 TRACE (Timer-4,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:28,144 TRACE (Timer-4,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:00:28,144 TRACE (Timer-4,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:00:28,162 TRACE (Timer-4,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeC-36650(s2), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|4], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeC-36650 2011-09-14 13:00:28,162 TRACE (Timer-4,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 13:00:28,162 TRACE (Timer-4,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] discovery took 29 ms: responses: 1 total (1 servers (0 coord), 0 clients) 2011-09-14 13:00:40,182 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:40,182 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:00:40,182 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:00:40,182 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeC-36650(s2), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|4], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeC-36650 2011-09-14 13:00:40,182 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 13:00:40,182 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] discovery took 0 ms: responses: 1 total (1 servers (0 coord), 0 clients) 2011-09-14 13:00:52,202 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:00:52,203 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:00:52,203 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:00:52,203 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeC-36650(s2), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|4], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeC-36650 2011-09-14 13:00:52,203 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 13:00:52,203 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] discovery took 1 ms: responses: 1 total (1 servers (0 coord), 0 clients) 2011-09-14 13:01:04,223 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:01:04,223 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:01:04,223 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:01:04,223 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeC-36650(s2), view id=[TopologyInfoBroadcastTest-NodeA-20211(s0)|4], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeC-36650 2011-09-14 13:01:04,223 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 13:01:04,223 TRACE (Timer-3,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] discovery took 0 ms: responses: 1 total (1 servers (0 coord), 0 clients) 2011-09-14 13:01:15,124 ERROR (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Method testNodeLeaves(org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest) threw an exception java.lang.RuntimeException: Timed out before caches had complete views. Expected 2 members in each view. Views are as follows: [[TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)]] at org.infinispan.test.TestingUtil.viewsTimedOut(TestingUtil.java:236) at org.infinispan.test.TestingUtil.viewsTimedOut(TestingUtil.java:226) at org.infinispan.test.TestingUtil.blockUntilViewsReceived(TestingUtil.java:344) at org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.testNodeLeaves(TopologyInfoBroadcastTest.java:92) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.testng.internal.MethodHelper.invokeMethod(MethodHelper.java:644) at org.testng.internal.Invoker.invokeMethod(Invoker.java:546) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:700) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1002) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:137) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:121) at org.testng.TestRunner.runWorkers(TestRunner.java:909) at org.testng.TestRunner.privateRun(TestRunner.java:618) at org.testng.TestRunner.run(TestRunner.java:499) at org.testng.SuiteRunner.runTest(SuiteRunner.java:332) at org.testng.SuiteRunner.access$000(SuiteRunner.java:33) at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:358) at org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:142) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2011-09-14 13:01:15,125 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest] *** Test method complete; clearing contents on all caches. 2011-09-14 13:01:15,125 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cleaning data for cache '___defaultcache' on a cache manager at address TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:01:15,125 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerBefore == [] 2011-09-14 13:01:15,125 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerAfter == [] 2011-09-14 13:01:15,125 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cleaning data for cache '___defaultcache' on a cache manager at address TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:01:15,125 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerBefore == [] 2011-09-14 13:01:15,125 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] removeInMemoryData(): dataContainerAfter == [] 2011-09-14 13:01:15,126 ERROR (testng-TopologyInfoBroadcastTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Test failed testNodeLeaves(org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest) java.lang.RuntimeException: Timed out before caches had complete views. Expected 2 members in each view. Views are as follows: [[TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)]] at org.infinispan.test.TestingUtil.viewsTimedOut(TestingUtil.java:236) at org.infinispan.test.TestingUtil.viewsTimedOut(TestingUtil.java:226) at org.infinispan.test.TestingUtil.blockUntilViewsReceived(TestingUtil.java:344) at org.infinispan.distribution.topologyaware.TopologyInfoBroadcastTest.testNodeLeaves(TopologyInfoBroadcastTest.java:92) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.testng.internal.MethodHelper.invokeMethod(MethodHelper.java:644) at org.testng.internal.Invoker.invokeMethod(Invoker.java:546) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:700) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1002) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:137) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:121) at org.testng.TestRunner.runWorkers(TestRunner.java:909) at org.testng.TestRunner.privateRun(TestRunner.java:618) at org.testng.TestRunner.run(TestRunner.java:499) at org.testng.SuiteRunner.runTest(SuiteRunner.java:332) at org.testng.SuiteRunner.access$000(SuiteRunner.java:33) at org.testng.SuiteRunner$SuiteWorker.run(SuiteRunner.java:358) at org.testng.internal.thread.ThreadUtil$CountDownLatchedRunnable.run(ThreadUtil.java:142) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2011-09-14 13:01:15,127 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command EntrySetCommand{set=[]} and InvocationContext [NonTxInvocationContext{flags=null}] 2011-09-14 13:01:15,127 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.CallInterceptor] Executing command: EntrySetCommand{set=[]}. 2011-09-14 13:01:15,128 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cache contents before stopping: [] 2011-09-14 13:01:15,128 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Stopping cache ___defaultcache on TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:01:15,128 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.TransactionTable] Wait for on-going transactions to finish for 30 seconds. 2011-09-14 13:01:15,128 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.TransactionTable] All transactions terminated 2011-09-14 13:01:15,128 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command EntrySetCommand{set=[]} and InvocationContext [NonTxInvocationContext{flags=null}] 2011-09-14 13:01:15,128 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.remoting.rpc.RpcManagerImpl] replication exception: org.infinispan.CacheException: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@2f0eca6creq_id=23263, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeC-36650(s2): sender=TopologyInfoBroadcastTest-NodeC-36650(s2), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.infinispan.util.Util.rewrapAsCacheException(Util.java:551) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:112) at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:403) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:136) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:164) at org.infinispan.statetransfer.BaseStateTransferManagerImpl.signalPushCompleted(BaseStateTransferManagerImpl.java:313) at org.infinispan.statetransfer.DistributedStateTransferTask.performRehash(DistributedStateTransferTask.java:138) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:77) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:43) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) Caused by: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@2f0eca6creq_id=23263, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeC-36650(s2): sender=TopologyInfoBroadcastTest-NodeC-36650(s2), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:531) at org.jgroups.blocks.MessageDispatcher.castMessage(MessageDispatcher.java:455) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.call(CommandAwareRpcDispatcher.java:233) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:110) ... 12 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2185) at org.jgroups.blocks.Request.responsesComplete(Request.java:224) at org.jgroups.blocks.Request.execute(Request.java:117) at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:527) ... 15 more 2011-09-14 13:01:15,129 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 13:01:15,128 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.interceptors.CallInterceptor] Executing command: EntrySetCommand{set=[]}. 2011-09-14 13:01:15,129 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.test.TestingUtil] Cache contents before stopping: [] 2011-09-14 13:01:15,129 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Stopping cache ___defaultcache on TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:01:15,129 ERROR (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.statetransfer.BaseStateTransferTask] ISPN000145: Error during rehash org.infinispan.CacheException: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@2f0eca6creq_id=23263, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeC-36650(s2): sender=TopologyInfoBroadcastTest-NodeC-36650(s2), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.infinispan.util.Util.rewrapAsCacheException(Util.java:551) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:112) at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:403) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:136) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:164) at org.infinispan.statetransfer.BaseStateTransferManagerImpl.signalPushCompleted(BaseStateTransferManagerImpl.java:313) at org.infinispan.statetransfer.DistributedStateTransferTask.performRehash(DistributedStateTransferTask.java:138) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:77) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:43) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) Caused by: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@2f0eca6creq_id=23263, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeC-36650(s2): sender=TopologyInfoBroadcastTest-NodeC-36650(s2), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:531) at org.jgroups.blocks.MessageDispatcher.castMessage(MessageDispatcher.java:455) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.call(CommandAwareRpcDispatcher.java:233) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:110) ... 12 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2185) at org.jgroups.blocks.Request.responsesComplete(Request.java:224) at org.jgroups.blocks.Request.execute(Request.java:117) at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:527) ... 15 more 2011-09-14 13:01:15,130 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.TransactionTable] Wait for on-going transactions to finish for 30 seconds. 2011-09-14 13:01:15,130 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.transaction.TransactionTable] All transactions terminated 2011-09-14 13:01:15,130 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.manager.DefaultCacheManager] Stopping cache manager Infinispan-Cluster on TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:01:15,131 TRACE (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.rpc.RpcManagerImpl] replication exception: org.infinispan.CacheException: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@6bafd914req_id=23264, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeA-20211(s0): sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.infinispan.util.Util.rewrapAsCacheException(Util.java:551) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:112) at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:403) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:136) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:164) at org.infinispan.statetransfer.BaseStateTransferManagerImpl.signalPushCompleted(BaseStateTransferManagerImpl.java:313) at org.infinispan.statetransfer.DistributedStateTransferTask.performRehash(DistributedStateTransferTask.java:138) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:77) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:43) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) Caused by: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@6bafd914req_id=23264, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeA-20211(s0): sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:531) at org.jgroups.blocks.MessageDispatcher.castMessage(MessageDispatcher.java:455) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.call(CommandAwareRpcDispatcher.java:233) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:110) ... 12 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2185) at org.jgroups.blocks.Request.responsesComplete(Request.java:224) at org.jgroups.blocks.Request.execute(Request.java:117) at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:527) ... 15 more 2011-09-14 13:01:15,131 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Stopping cache ___defaultcache on TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:01:15,131 DEBUG (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.StateTransferLockImpl] Unblocking new transactions 2011-09-14 13:01:15,131 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000080: Disconnecting and closing JGroups Channel 2011-09-14 13:01:15,131 ERROR (Rehasher,___defaultcache,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.statetransfer.BaseStateTransferTask] ISPN000145: Error during rehash org.infinispan.CacheException: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@6bafd914req_id=23264, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeA-20211(s0): sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.infinispan.util.Util.rewrapAsCacheException(Util.java:551) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:112) at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:403) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:136) at org.infinispan.remoting.rpc.RpcManagerImpl.invokeRemotely(RpcManagerImpl.java:164) at org.infinispan.statetransfer.BaseStateTransferManagerImpl.signalPushCompleted(BaseStateTransferManagerImpl.java:313) at org.infinispan.statetransfer.DistributedStateTransferTask.performRehash(DistributedStateTransferTask.java:138) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:77) at org.infinispan.statetransfer.BaseStateTransferTask.call(BaseStateTransferTask.java:43) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) Caused by: java.lang.RuntimeException: failed executing request org.jgroups.blocks.GroupRequest@6bafd914req_id=23264, mode=GET_ALL, entries: TopologyInfoBroadcastTest-NodeB-32215(s1): sender=TopologyInfoBroadcastTest-NodeB-32215(s1), retval=null, received=false, suspected=false TopologyInfoBroadcastTest-NodeA-20211(s0): sender=TopologyInfoBroadcastTest-NodeA-20211(s0), retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:531) at org.jgroups.blocks.MessageDispatcher.castMessage(MessageDispatcher.java:455) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher$ReplicationTask.call(CommandAwareRpcDispatcher.java:233) at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:110) ... 12 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2185) at org.jgroups.blocks.Request.responsesComplete(Request.java:224) at org.jgroups.blocks.Request.execute(Request.java:117) at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:527) ... 15 more 2011-09-14 13:01:15,133 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] new=[], suspected=[], leaving=[TopologyInfoBroadcastTest-NodeA-20211(s0)], new view: [TopologyInfoBroadcastTest-NodeB-32215(s1)|5] [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:01:15,166 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeC-36650(s2): view is [TopologyInfoBroadcastTest-NodeB-32215(s1)|5] [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:01:15,166 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.NAKACK] removed TopologyInfoBroadcastTest-NodeA-20211(s0) from xmit_table (not member anymore) 2011-09-14 13:01:15,167 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 800KB (2 members) 2011-09-14 13:01:15,167 DEBUG (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [TopologyInfoBroadcastTest-NodeB-32215(s1)|5] [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:01:15,168 INFO (Incoming-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeC-36650(s2)) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [TopologyInfoBroadcastTest-NodeB-32215(s1)|5] [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] 2011-09-14 13:01:16,243 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Discoveries for DiscoveryKey{clusterName='Infinispan-Cluster', testName='topologyaware.TopologyInfoBroadcastTest'} are : {TopologyInfoBroadcastTest-NodeC-36650(s2)=TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2), TopologyInfoBroadcastTest-NodeA-20211(s0)=TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0)} 2011-09-14 13:01:16,254 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeC-36650(s2) with physical address 127.0.0.1:8302 in TEST_PING@TopologyInfoBroadcastTest-NodeA-20211(s0) 2011-09-14 13:01:16,254 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Map TopologyInfoBroadcastTest-NodeA-20211(s0) with physical address 127.0.0.1:8300 in TEST_PING@TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:01:16,254 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Returning ping rsp: own_addr=TopologyInfoBroadcastTest-NodeC-36650(s2), view id=[TopologyInfoBroadcastTest-NodeB-32215(s1)|5], is_server=true, is_coord=false, logical_name=TopologyInfoBroadcastTest-NodeC-36650 2011-09-14 13:01:16,255 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] Skipping sending discovery to self 2011-09-14 13:01:16,256 TRACE (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.infinispan.test.fwk.TEST_PING] discovery took 13 ms: responses: 1 total (1 servers (0 coord), 0 clients) 2011-09-14 13:01:16,256 DEBUG (Timer-2,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.MERGE2] TopologyInfoBroadcastTest-NodeA-20211(s0) found different views : [TopologyInfoBroadcastTest-NodeB-32215(s1)|5], [TopologyInfoBroadcastTest-NodeA-20211(s0)|4]; sending up MERGE event with merge participants [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeA-20211(s0)]. Discovery results: [TopologyInfoBroadcastTest-NodeC-36650(s2)]: [TopologyInfoBroadcastTest-NodeB-32215(s1)|5] [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] [TopologyInfoBroadcastTest-NodeA-20211(s0)]: MergeView::[TopologyInfoBroadcastTest-NodeA-20211(s0)|4] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)], subgroups=[[TopologyInfoBroadcastTest-NodeA-20211(s0)|2] [TopologyInfoBroadcastTest-NodeB-32215(s1)], [TopologyInfoBroadcastTest-NodeA-20211(s0)|3] [TopologyInfoBroadcastTest-NodeA-20211(s0), TopologyInfoBroadcastTest-NodeC-36650(s2)]] 2011-09-14 13:01:17,134 WARN (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): failed to collect all ACKs (expected=2) for view [TopologyInfoBroadcastTest-NodeB-32215(s1)|5] [TopologyInfoBroadcastTest-NodeB-32215(s1), TopologyInfoBroadcastTest-NodeC-36650(s2)] after 2000ms, missing ACKs from [TopologyInfoBroadcastTest-NodeB-32215(s1)] 2011-09-14 13:01:17,135 DEBUG (ViewHandler,Infinispan-Cluster,TopologyInfoBroadcastTest-NodeA-20211(s0)) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeA-20211(s0): 2011-09-14 13:01:17,136 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.TCP] closing sockets and stopping threads 2011-09-14 13:01:17,137 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher 2011-09-14 13:01:17,137 TRACE (testng-TopologyInfoBroadcastTest) [org.infinispan.manager.DefaultCacheManager] Ignore call to stop as the cache manager is stopping 2011-09-14 13:01:17,137 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.manager.DefaultCacheManager] Stopping cache manager Infinispan-Cluster on TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:01:17,138 DEBUG (testng-TopologyInfoBroadcastTest) [org.infinispan.CacheImpl] Stopping cache ___defaultcache on TopologyInfoBroadcastTest-NodeC-36650(s2) 2011-09-14 13:01:17,138 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000080: Disconnecting and closing JGroups Channel 2011-09-14 13:01:17,138 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending LEAVE request to TopologyInfoBroadcastTest-NodeB-32215(s1) (local_addr=TopologyInfoBroadcastTest-NodeC-36650(s2)) 2011-09-14 13:01:22,139 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending LEAVE request to TopologyInfoBroadcastTest-NodeB-32215(s1) (local_addr=TopologyInfoBroadcastTest-NodeC-36650(s2)) 2011-09-14 13:01:27,140 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] sending LEAVE request to TopologyInfoBroadcastTest-NodeB-32215(s1) (local_addr=TopologyInfoBroadcastTest-NodeC-36650(s2)) 2011-09-14 13:01:32,141 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.pbcast.GMS] TopologyInfoBroadcastTest-NodeC-36650(s2): 2011-09-14 13:01:32,141 DEBUG (testng-TopologyInfoBroadcastTest) [org.jgroups.protocols.TCP] closing sockets and stopping threads 2011-09-14 13:01:32,143 INFO (testng-TopologyInfoBroadcastTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher