2013-03-26 15:36:00,410 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Starting test testTransactional(org.infinispan.distribution.rehash.ConcurrentNonOverlappingLeaveTest) 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Implicit transaction started! 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Marked tx as implicit. 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@4798d856] 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712d 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] registering synchronization handler SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712d} org.infinispan.transaction.synchronization.SynchronizationAdapter@714c 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] Wrapping entry 'MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}'? true 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.TxDistributionInterceptor] Not doing a remote get for key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} since entry is mapped to current node (ConcurrentNonOverlappingLeaveTest-NodeE-28744), or is in L1. Owners are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] The return value is null 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding modification PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. Mod list is null 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Committing transaction as it was implicit: DummyTransaction{xid=DummyXid{id=5961}, status=0} 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing beforeCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712d} org.infinispan.transaction.synchronization.SynchronizationAdapter@714c 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712d 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@3a31ad3] 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Locking key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, no need to check for pending locks. 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to lock MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} with acquisition timeout of 45000 millis 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Creating and acquiring new lock instance for key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Successfully acquired lock MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}! 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Registering locked key: MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeE-28744 broadcasting call PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,410 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeF-11796 with response mode GET_ALL 2013-03-26 15:36:00,411 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.transaction.TransactionTable] Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={}, lockedKeys=null, backupKeyLocks=null, missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28973:remote} 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.commands.tx.PrepareCommand] Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@2f2a7a9f 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@2f2a7a9f] 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.transaction.RemoteTransaction] Adding key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} to tx GlobalTransaction::28973:remote 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,412 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,412 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,412 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeF-11796=null} 2013-03-26 15:36:00,412 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding remote locks on [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796]. Remote locks are null 2013-03-26 15:36:00,412 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,412 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,412 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing afterCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], isMarkedForRollback=false, lockedKeys=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712d} org.infinispan.transaction.synchronization.SynchronizationAdapter@714c 2013-03-26 15:36:00,412 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], isMarkedForRollback=false, lockedKeys=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712d. 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Committing transaction GlobalTransaction::28973:local 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@2ca79b8] 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeE-28744 broadcasting call CommitCommand {gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], command=CommitCommand {gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,413 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CommitCommand {gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeF-11796 with response mode GET_ALL 2013-03-26 15:36:00,413 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: CommitCommand {gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on CommitCommand {gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] About to execute tx command CommitCommand {gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@2f2a7a9f] 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(405e413b){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} removed=false valid=true changed=true created=true loaded=false value=v1] 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,413 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTransaction::28973:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,416 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: SuccessfulResponse{responseValue=null} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to CommitCommand {gtx=GlobalTransaction::28973:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeF-11796=SuccessfulResponse{responseValue=null} } 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6c0ca980){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} removed=false valid=true changed=true created=true loaded=false value=v1] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Unlocking lock instance for key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Clearing locked keys: [MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Removed LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712d from transaction table. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28973:local has completed, notifying listening threads. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractEnlistmentAdapter] About to invoke tx completion notification on commitNodes: [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeE-28744 broadcasting call TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTransaction::28973:local, cacheName=dist} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28973:local, cacheName=dist} , mode=ASYNCHRONOUS_WITH_SYNC_MARSHALLING, timeout=60000 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28973:local, cacheName=dist} to single recipient ConcurrentNonOverlappingLeaveTest-NodeF-11796 with response mode GET_NONE 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28973:local, cacheName=dist} is {} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Implicit transaction started! 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Marked tx as implicit. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@5588fd9c] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712e 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] registering synchronization handler SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712e} org.infinispan.transaction.synchronization.SynchronizationAdapter@714d 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] Wrapping entry 'MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}'? true 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.TxDistributionInterceptor] Not doing a remote get for key MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} since entry is mapped to current node (ConcurrentNonOverlappingLeaveTest-NodeF-11796), or is in L1. Owners are [ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] The return value is null 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding modification PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. Mod list is null 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Committing transaction as it was implicit: DummyTransaction{xid=DummyXid{id=5962}, status=0} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing beforeCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712e} org.infinispan.transaction.synchronization.SynchronizationAdapter@714d 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712e 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@14c238a3] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Locking key MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, no need to check for pending locks. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to lock MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} with acquisition timeout of 45000 millis 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Creating and acquiring new lock instance for key MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Successfully acquired lock MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}! 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Registering locked key: MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeF-11796 broadcasting call PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,417 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeH-5050 with response mode GET_ALL 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.transaction.TransactionTable] Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={}, lockedKeys=null, backupKeyLocks=null, missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28974:remote} 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.commands.tx.PrepareCommand] Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@b70a5776 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b70a5776] 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.transaction.RemoteTransaction] Adding key MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} to tx GlobalTransaction::28974:remote 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,418 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28973:local, cacheName=dist} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28973:local, cacheName=dist} 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Processing completed transaction GlobalTransaction::28973:local 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.transaction.TransactionTable] Removed remote transaction GlobalTransaction::28973:local ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}=ReadCommittedEntry(405e413b){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28973:remote} 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.transaction.TransactionTable] Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}=ReadCommittedEntry(405e413b){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28973:remote} from transaction table. 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28973:remote has completed, notifying listening threads. 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Invoking forward of TxCompletionNotification for transaction GlobalTransaction::28973:local. Affected keys: [MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}] 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock keys [] 2013-03-26 15:36:00,418 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28973:local, cacheName=dist} 2013-03-26 15:36:00,418 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:00,418 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeF-11796) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeH-5050=null} 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding remote locks on [ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Remote locks are null 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing afterCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], isMarkedForRollback=false, lockedKeys=[MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712e} org.infinispan.transaction.synchronization.SynchronizationAdapter@714d 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], isMarkedForRollback=false, lockedKeys=[MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712e. 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Committing transaction GlobalTransaction::28974:local 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@2a0dae18] 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeF-11796 broadcasting call CommitCommand {gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], command=CommitCommand {gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CommitCommand {gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeH-5050 with response mode GET_ALL 2013-03-26 15:36:00,420 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: CommitCommand {gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on CommitCommand {gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] About to execute tx command CommitCommand {gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@b70a5776] 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(3dea6c97){key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} removed=false valid=true changed=true created=true loaded=false value=v2] 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,420 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTransaction::28974:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: SuccessfulResponse{responseValue=null} 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to CommitCommand {gtx=GlobalTransaction::28974:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeH-5050=SuccessfulResponse{responseValue=null} } 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(697f4d42){key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} removed=false valid=true changed=true created=true loaded=false value=v2] 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Unlocking lock instance for key MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796} 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Clearing locked keys: [MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}] 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Removed LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712e from transaction table. 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28974:local has completed, notifying listening threads. 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractEnlistmentAdapter] About to invoke tx completion notification on commitNodes: [ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,420 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeF-11796 broadcasting call TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTransaction::28974:local, cacheName=dist} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28974:local, cacheName=dist} , mode=ASYNCHRONOUS_WITH_SYNC_MARSHALLING, timeout=60000 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28974:local, cacheName=dist} to single recipient ConcurrentNonOverlappingLeaveTest-NodeH-5050 with response mode GET_NONE 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28974:local, cacheName=dist} is {} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Implicit transaction started! 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Marked tx as implicit. 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6b652a33] 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712f 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] registering synchronization handler SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712f} org.infinispan.transaction.synchronization.SynchronizationAdapter@714e 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] Wrapping entry 'MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}'? true 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.TxDistributionInterceptor] Not doing a remote get for key MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} since entry is mapped to current node (ConcurrentNonOverlappingLeaveTest-NodeG-31669), or is in L1. Owners are [ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] The return value is null 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding modification PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. Mod list is null 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Committing transaction as it was implicit: DummyTransaction{xid=DummyXid{id=5963}, status=0} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing beforeCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712f} org.infinispan.transaction.synchronization.SynchronizationAdapter@714e 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712f 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@3eb5b15a] 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Locking key MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, no need to check for pending locks. 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to lock MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} with acquisition timeout of 45000 millis 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Creating and acquiring new lock instance for key MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Successfully acquired lock MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}! 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Registering locked key: MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28974:local, cacheName=dist} [sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeG-31669 broadcasting call PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28974:local, cacheName=dist} 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Processing completed transaction GlobalTransaction::28974:local 2013-03-26 15:36:00,421 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_ALL 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.transaction.TransactionTable] Removed remote transaction GlobalTransaction::28974:local ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}=ReadCommittedEntry(3dea6c97){key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28974:remote} 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.transaction.TransactionTable] Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}=ReadCommittedEntry(3dea6c97){key=MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}, value=v2, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28974:remote} from transaction table. 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28974:remote has completed, notifying listening threads. 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Invoking forward of TxCompletionNotification for transaction GlobalTransaction::28974:local. Affected keys: [MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}] 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock keys [] 2013-03-26 15:36:00,421 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28974:local, cacheName=dist} 2013-03-26 15:36:00,421 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,421 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,421 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={}, lockedKeys=null, backupKeyLocks=null, missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28975:remote} 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.commands.tx.PrepareCommand] Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@4229a092 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@4229a092] 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.RemoteTransaction] Adding key MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} to tx GlobalTransaction::28975:remote 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeE-28744=null} 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding remote locks on [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]. Remote locks are null 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing afterCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], isMarkedForRollback=false, lockedKeys=[MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712f} org.infinispan.transaction.synchronization.SynchronizationAdapter@714e 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], isMarkedForRollback=false, lockedKeys=[MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712f. 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Committing transaction GlobalTransaction::28975:local 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@4762cd54] 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeG-31669 broadcasting call CommitCommand {gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=CommitCommand {gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CommitCommand {gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_ALL 2013-03-26 15:36:00,422 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: CommitCommand {gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on CommitCommand {gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] About to execute tx command CommitCommand {gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@4229a092] 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(42427cd){key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} removed=false valid=true changed=true created=true loaded=false value=v3] 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,422 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTransaction::28975:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: SuccessfulResponse{responseValue=null} 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to CommitCommand {gtx=GlobalTransaction::28975:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeE-28744=SuccessfulResponse{responseValue=null} } 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(61b105da){key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,422 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} removed=false valid=true changed=true created=true loaded=false value=v3] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Unlocking lock instance for key MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Clearing locked keys: [MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Removed LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@712f from transaction table. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28975:local has completed, notifying listening threads. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractEnlistmentAdapter] About to invoke tx completion notification on commitNodes: [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeG-31669 broadcasting call TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTransaction::28975:local, cacheName=dist} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28975:local, cacheName=dist} , mode=ASYNCHRONOUS_WITH_SYNC_MARSHALLING, timeout=60000 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28975:local, cacheName=dist} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_NONE 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28975:local, cacheName=dist} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28975:local, cacheName=dist} is {} 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28975:local, cacheName=dist} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Implicit transaction started! 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Processing completed transaction GlobalTransaction::28975:local 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Marked tx as implicit. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@240f87e7] 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Removed remote transaction GlobalTransaction::28975:local ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}=ReadCommittedEntry(42427cd){key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28975:remote} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}=ReadCommittedEntry(42427cd){key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=v3, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28975:remote} from transaction table. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@7130 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28975:remote has completed, notifying listening threads. 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Invoking forward of TxCompletionNotification for transaction GlobalTransaction::28975:local. Affected keys: [MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}] 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock keys [] 2013-03-26 15:36:00,423 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28975:local, cacheName=dist} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] registering synchronization handler SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@7130} org.infinispan.transaction.synchronization.SynchronizationAdapter@714f 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] Wrapping entry 'MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}'? true 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.TxDistributionInterceptor] Not doing a remote get for key MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} since entry is mapped to current node (ConcurrentNonOverlappingLeaveTest-NodeH-5050), or is in L1. Owners are [ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] The return value is null 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding modification PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. Mod list is null 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Committing transaction as it was implicit: DummyTransaction{xid=DummyXid{id=5964}, status=0} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing beforeCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@7130} org.infinispan.transaction.synchronization.SynchronizationAdapter@714f 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@7130 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Sending prepare command through the chain: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@77a3612f] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Locking key MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, no need to check for pending locks. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to lock MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} with acquisition timeout of 45000 millis 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Creating and acquiring new lock instance for key MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Successfully acquired lock MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}! 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Registering locked key: MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=false 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeH-5050 broadcasting call PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,423 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeG-31669 with response mode GET_ALL 2013-03-26 15:36:00,424 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={}, lockedKeys=null, backupKeyLocks=null, missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28976:remote} 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.commands.tx.PrepareCommand] Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@a0438c47 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@a0438c47] 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.RemoteTransaction] Adding key MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} to tx GlobalTransaction::28976:remote 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeG-31669=null} 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] Adding remote locks on [ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669]. Remote locks are null 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.tm.DummyTransaction] processing afterCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], isMarkedForRollback=false, lockedKeys=[MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@7130} org.infinispan.transaction.synchronization.SynchronizationAdapter@714f 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.synchronization.SynchronizationAdapter] afterCompletion(3) called for LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], isMarkedForRollback=false, lockedKeys=[MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}], backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@7130. 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionCoordinator] Committing transaction GlobalTransaction::28976:local 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@174dec1b] 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=-1} 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? true. hasModifications=true, hasRemoteLocksAcquired=true 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeH-5050 broadcasting call CommitCommand {gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=CommitCommand {gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6}, mode=SYNCHRONOUS, timeout=60000 2013-03-26 15:36:00,424 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CommitCommand {gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} to single recipient ConcurrentNonOverlappingLeaveTest-NodeG-31669 with response mode GET_ALL 2013-03-26 15:36:00,424 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: CommitCommand {gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} [sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on CommitCommand {gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] About to execute tx command CommitCommand {gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@a0438c47] 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,424 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(297c21f0){key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,425 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} removed=false valid=true changed=true created=true loaded=false value=v4] 2013-03-26 15:36:00,425 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,425 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTransaction::28976:remote, cacheName='dist', topologyId=6} 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: SuccessfulResponse{responseValue=null} 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to CommitCommand {gtx=GlobalTransaction::28976:local, cacheName='dist', topologyId=6} is {ConcurrentNonOverlappingLeaveTest-NodeG-31669=SuccessfulResponse{responseValue=null} } 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(149828d7){key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} removed=false valid=true changed=true created=true loaded=false value=v4] 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.util.concurrent.locks.containers.OwnableReentrantPerEntryLockContainer] Unlocking lock instance for key MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Clearing locked keys: [MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}] 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Removed LocalTransaction{remoteLockedNodes=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=6, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@7130 from transaction table. 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28976:local has completed, notifying listening threads. 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.LocalTransaction] getCommitNodes recipients=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], currentTopologyId=6, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], txTopologyId=6 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.AbstractEnlistmentAdapter] About to invoke tx completion notification on commitNodes: [ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeH-5050 broadcasting call TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTransaction::28976:local, cacheName=dist} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28976:local, cacheName=dist} , mode=ASYNCHRONOUS_WITH_SYNC_MARSHALLING, timeout=60000 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28976:local, cacheName=dist} to single recipient ConcurrentNonOverlappingLeaveTest-NodeG-31669 with response mode GET_NONE 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.rpc.RpcManagerImpl] Response(s) to TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28976:local, cacheName=dist} is {} 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28976:local, cacheName=dist} [sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28976:local, cacheName=dist} 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Processing completed transaction GlobalTransaction::28976:local 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Removed remote transaction GlobalTransaction::28976:local ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}=ReadCommittedEntry(297c21f0){key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28976:remote} 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}=ReadCommittedEntry(297c21f0){key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, oldValue=null, isCreated=false, isChanged=false, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}], missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28976:remote} from transaction table. 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28976:remote has completed, notifying listening threads. 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Invoking forward of TxCompletionNotification for transaction GlobalTransaction::28976:local. Affected keys: [MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}] 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=6, localTopologyId=6 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.util.concurrent.locks.LockManagerImpl] Attempting to unlock keys [] 2013-03-26 15:36:00,425 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=6, gtx=GlobalTransaction::28976:local, cacheName=dist} 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command EntrySetCommand{set=2 elements} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@2255dae6] 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: EntrySetCommand{set=2 elements}. 2013-03-26 15:36:00,425 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.TestingUtil] Cache contents on ConcurrentNonOverlappingLeaveTest-NodeF-11796 before stopping: [MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}=v2, MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}=v1] 2013-03-26 15:36:00,425 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeF-11796 2013-03-26 15:36:00,426 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Wait for on-going transactions to finish for 0 milliseconds. 2013-03-26 15:36:00,426 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] All transactions terminated 2013-03-26 15:36:00,426 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateConsumerImpl] Shutting down StateConsumer of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeF-11796 2013-03-26 15:36:00,426 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateProviderImpl] Shutting down StateProvider of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeF-11796 2013-03-26 15:36:00,426 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] Shutting down StateTransferManager of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeF-11796 2013-03-26 15:36:00,426 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.LocalTopologyManagerImpl] Node ConcurrentNonOverlappingLeaveTest-NodeF-11796 leaving cache dist 2013-03-26 15:36:00,426 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=3}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:36:00,426 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=3} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_ALL 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796] 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Removed node ConcurrentNonOverlappingLeaveTest-NodeF-11796 from cache dist: members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], joiners = [] 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Cache dist topology updated: members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], joiners = [], topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Cache dist topology updated: CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 2 0, 17: 2 0, 18: 2 0, 19: 2 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 2, 31: 2, 32: 2, 33: 2, 34: 2, 35: 2, 36: 2, 37: 2, 38: 2, 39: 2, 40: 1, 41: 1, 42: 1, 43: 1, 44: 2, 45: 2, 46: 2, 47: 2, 48: 2, 49: 2 1, 50: 1, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 2 1, 59: 2 1 2013-03-26 15:36:00,427 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cluster-wide consistent hash for cache dist, topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,427 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 2 0, 17: 2 0, 18: 2 0, 19: 2 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 2, 31: 2, 32: 2, 33: 2, 34: 2, 35: 2, 36: 2, 37: 2, 38: 2, 39: 2, 40: 1, 41: 1, 42: 1, 43: 1, 44: 2, 45: 2, 46: 2, 47: 2, 48: 2, 49: 2 1, 50: 1, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 2 1, 59: 2 1 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} on cache dist 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 7 is installed 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28]; added segments: [] 2013-03-26 15:36:00,427 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:36:00,427 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28] or [] for cache dist 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = false, isRebalance = false, pending CH = null 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 7 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], remote transactions: 0 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:36:00,427 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:36:00,427 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 6 to 7 2013-03-26 15:36:00,427 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null, throwable=null, viewId=3}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:36:00,427 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null, throwable=null, viewId=3} to addresses null with response mode GET_ALL 2013-03-26 15:36:00,427 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,428 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,428 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,428 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring consistent hash update 7 for cache dist that doesn't exist locally 2013-03-26 15:36:00,439 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 2 0, 17: 2 0, 18: 2 0, 19: 2 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 2, 31: 2, 32: 2, 33: 2, 34: 2, 35: 2, 36: 2, 37: 2, 38: 2, 39: 2, 40: 1, 41: 1, 42: 1, 43: 1, 44: 2, 45: 2, 46: 2, 47: 2, 48: 2, 49: 2 1, 50: 1, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 2 1, 59: 2 1 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} on cache dist 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 7 is installed 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [15, 17, 16, 19, 18, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 46, 47, 44, 45, 51, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [15, 17, 16, 19, 18, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 46, 47, 44, 45, 51, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [] 2013-03-26 15:36:00,439 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:36:00,439 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [15, 17, 16, 19, 18, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 46, 47, 44, 45, 51, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = false, isRebalance = false, pending CH = null 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 7 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], remote transactions: 0 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:36:00,439 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 6 to 7 2013-03-26 15:36:00,439 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 2 0, 17: 2 0, 18: 2 0, 19: 2 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 2, 31: 2, 32: 2, 33: 2, 34: 2, 35: 2, 36: 2, 37: 2, 38: 2, 39: 2, 40: 1, 41: 1, 42: 1, 43: 1, 44: 2, 45: 2, 46: 2, 47: 2, 48: 2, 49: 2 1, 50: 1, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 2 1, 59: 2 1 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} on cache dist 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,439 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 7 is installed 2013-03-26 15:36:00,440 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 42, 43, 40, 41, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 42, 43, 40, 41, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [] 2013-03-26 15:36:00,440 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:36:00,440 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 42, 43, 40, 41, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:36:00,440 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = false, isRebalance = false, pending CH = null 2013-03-26 15:36:00,440 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 7 2013-03-26 15:36:00,440 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], remote transactions: 0 2013-03-26 15:36:00,440 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:36:00,440 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:36:00,440 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:36:00,440 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 6 to 7 2013-03-26 15:36:00,440 TRACE (Updater) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@24f7678d] 2013-03-26 15:36:00,440 TRACE (Updater) [org.infinispan.interceptors.distribution.TxDistributionInterceptor] Not doing a remote get for key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} since entry is mapped to current node (ConcurrentNonOverlappingLeaveTest-NodeE-28744), or is in L1. Owners are [ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,440 TRACE (Updater) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28977:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6eaf6cf0] 2013-03-26 15:36:00,440 TRACE (Updater) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeE-28744 broadcasting call PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28977:local, cacheName='dist', topologyId=7} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,440 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796, retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2013-03-26 15:36:00,441 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Cache dist status changed: joiners=[], topology=CacheTopology{id=7, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=null} 2013-03-26 15:36:00,441 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Triggering rebalance for cache dist 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Rebalancing consistent hash for cache dist, members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cache dist topology for rebalance: CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 2 0, 17: 2 0, 18: 2 0, 19: 2 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 2, 31: 2, 32: 2, 33: 2, 34: 2, 35: 2, 36: 2, 37: 2, 38: 2, 39: 2, 40: 1, 41: 1, 42: 1, 43: 1, 44: 2, 45: 2, 46: 2, 47: 2, 48: 2, 49: 2 1, 50: 1, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 2 1, 59: 2 1 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 2, 2: 0 1, 3: 0 2, 4: 0 1, 5: 0 2, 6: 0 1, 7: 0 2, 8: 0 1, 9: 0 2, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 0 2, 17: 0 2, 18: 0 2, 19: 0 2, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 2 0, 31: 2 0, 32: 2 0, 33: 2 0, 34: 2 0, 35: 2 0, 36: 2 1, 37: 2 0, 38: 2 1, 39: 2 0, 40: 1 2, 41: 1 2, 42: 1 2, 43: 1 2, 44: 2 1, 45: 2 1, 46: 2 0, 47: 2 1, 48: 2 0, 49: 2 1, 50: 1 2, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 1 2, 59: 1 2 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.RebalanceConfirmationCollector] Initialized rebalance confirmation collector 8@dist, initial list is [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Cache dist status changed: joiners=[], topology=CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Not triggering rebalance for cache dist, a rebalance is already in progress 2013-03-26 15:36:00,441 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Starting cluster-wide rebalance for cache dist, topology = CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} 2013-03-26 15:36:00,441 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.LocalTopologyManagerImpl] Starting local rebalance for cache dist, topology = CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} 2013-03-26 15:36:00,441 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, throwable=null, viewId=3}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 2 0, 17: 2 0, 18: 2 0, 19: 2 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 2, 31: 2, 32: 2, 33: 2, 34: 2, 35: 2, 36: 2, 37: 2, 38: 2, 39: 2, 40: 1, 41: 1, 42: 1, 43: 1, 44: 2, 45: 2, 46: 2, 47: 2, 48: 2, 49: 2 1, 50: 1, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 2 1, 59: 2 1 2013-03-26 15:36:00,441 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, throwable=null, viewId=3} to addresses null with response mode GET_ALL 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 2, 2: 0 1, 3: 0 2, 4: 0 1, 5: 0 2, 6: 0 1, 7: 0 2, 8: 0 1, 9: 0 2, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 0 2, 17: 0 2, 18: 0 2, 19: 0 2, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 2 0, 31: 2 0, 32: 2 0, 33: 2 0, 34: 2 0, 35: 2 0, 36: 2 1, 37: 2 0, 38: 2 1, 39: 2 0, 40: 1 2, 41: 1 2, 42: 1 2, 43: 1 2, 44: 2 1, 45: 2 1, 46: 2 0, 47: 2 1, 48: 2 0, 49: 2 1, 50: 1 2, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 1 2, 59: 1 2 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} on cache dist 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = true, topology = CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 8 is installed 2013-03-26 15:36:00,441 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28]; added segments: [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] 2013-03-26 15:36:00,441 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:36:00,441 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48] or [] for cache dist 2013-03-26 15:36:00,441 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Adding inbound state transfer for segments [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] of cache dist 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Requesting transactions for segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeH-5050], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=8, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:36:00,441 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=8, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeH-5050] with response mode GET_ALL 2013-03-26 15:36:00,442 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=8, segments=[34, 35, 32, 33, 48, 39, 37, 46, 31, 30]} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=8, segments=[34, 35, 32, 33, 48, 39, 37, 46, 31, 30]} 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateProviderImpl] Received request for transactions from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 for segments [34, 35, 32, 33, 48, 39, 37, 46, 31, 30] of cache dist with topology id 8 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateProviderImpl] Transactions were requested by node ConcurrentNonOverlappingLeaveTest-NodeE-28744 with topology 8, greater than the local topology (7). Waiting for topology 8 to be installed locally. 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferLockImpl] Waiting for topology 8 to be installed, current topology is 7 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring rebalance 8 for cache dist that doesn't exist locally 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,442 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Starting local rebalance for cache dist, topology = CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 2 0, 17: 2 0, 18: 2 0, 19: 2 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 2, 31: 2, 32: 2, 33: 2, 34: 2, 35: 2, 36: 2, 37: 2, 38: 2, 39: 2, 40: 1, 41: 1, 42: 1, 43: 1, 44: 2, 45: 2, 46: 2, 47: 2, 48: 2, 49: 2 1, 50: 1, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 2 1, 59: 2 1 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 2, 2: 0 1, 3: 0 2, 4: 0 1, 5: 0 2, 6: 0 1, 7: 0 2, 8: 0 1, 9: 0 2, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 2 0, 16: 0 2, 17: 0 2, 18: 0 2, 19: 0 2, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 2 0, 31: 2 0, 32: 2 0, 33: 2 0, 34: 2 0, 35: 2 0, 36: 2 1, 37: 2 0, 38: 2 1, 39: 2 0, 40: 1 2, 41: 1 2, 42: 1 2, 43: 1 2, 44: 2 1, 45: 2 1, 46: 2 0, 47: 2 1, 48: 2 0, 49: 2 1, 50: 1 2, 51: 1 2, 52: 1 2, 53: 1 2, 54: 1 2, 55: 2 1, 56: 2 1, 57: 2 1, 58: 1 2, 59: 1 2 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} on cache dist 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = true, topology = CacheTopology{id=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}} 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 8 is installed 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 42, 43, 40, 41, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [0, 2, 4, 6, 8, 38, 36, 47, 44, 45] 2013-03-26 15:36:00,442 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:36:00,442 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:36:00,442 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Adding inbound state transfer for segments [0, 2, 4, 6, 8, 38, 36, 47, 44, 45] of cache dist 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Requesting transactions for segments [0, 2, 4, 6, 8] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[0, 2, 4, 6, 8]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:36:00,442 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[0, 2, 4, 6, 8]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeE-28744] with response mode GET_ALL 2013-03-26 15:36:00,443 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[0, 2, 4, 6, 8]} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[0, 2, 4, 6, 8]} 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Received request for transactions from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 for segments [0, 2, 4, 6, 8] of cache dist with topology id 8 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Found 0 transaction(s) to transfer 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[0, 2, 4, 6, 8]} 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, retval=SuccessfulResponse{responseValue=[]} , received=true, suspected=false] 2013-03-26 15:36:00,443 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying 0 transactions for cache dist transferred from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Requesting transactions for segments [38, 36, 47, 44, 45] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeH-5050], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[38, 36, 47, 44, 45]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:36:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[38, 36, 47, 44, 45]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeH-5050] with response mode GET_ALL 2013-03-26 15:36:00,443 TRACE (OOB-4,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[38, 36, 47, 44, 45]} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: SuccessfulResponse{responseValue=null} 2013-03-26 15:36:00,446 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.xsite.BackupReceiverRepositoryImpl] Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'dist' 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command EntrySetCommand{set=2 elements} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@243bcd2] 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: EntrySetCommand{set=2 elements}. 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.TestingUtil] Cache contents on ConcurrentNonOverlappingLeaveTest-NodeH-5050 before stopping: [MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}=v4, MagicKey#k2{21658f59@ConcurrentNonOverlappingLeaveTest-NodeF-11796}=v2] 2013-03-26 15:36:00,446 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:36:00,446 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Wait for on-going transactions to finish for 0 milliseconds. 2013-03-26 15:36:00,446 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] All transactions terminated 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateConsumerImpl] Shutting down StateConsumer of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateProviderImpl] Shutting down StateProvider of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] Shutting down StateTransferManager of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:36:00,446 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.LocalTopologyManagerImpl] Node ConcurrentNonOverlappingLeaveTest-NodeH-5050 leaving cache dist 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=3}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:36:00,446 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=3} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_ALL 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Removed node ConcurrentNonOverlappingLeaveTest-NodeH-5050 from cache dist: members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], joiners = [] 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Cache dist topology updated: members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], joiners = [], topology = CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Cache dist topology updated: CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 1 0, 32: 0 1, 33: 1 0, 34: 0 1, 35: 1 0, 36: 0 1, 37: 1 0, 38: 0 1, 39: 1 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 1, 37: 0, 38: 1, 39: 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 1, 45: 1, 46: 0, 47: 1, 48: 0, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.RebalanceConfirmationCollector] Rebalance confirmation collector 8@dist members list updated, remaining list is [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,447 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cluster-wide consistent hash for cache dist, topology = CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:36:00,447 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=3}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:36:00,447 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=3} to addresses null with response mode GET_ALL 2013-03-26 15:36:00,447 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring consistent hash update 9 for cache dist that doesn't exist locally 2013-03-26 15:36:00,449 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=8, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]}, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,449 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring rebalance 8 for cache dist that doesn't exist locally 2013-03-26 15:36:00,474 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,476 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:36:00,477 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring consistent hash update 9 for cache dist that doesn't exist locally 2013-03-26 15:36:00,490 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=8, segments=[38, 36, 47, 44, 45]} 2013-03-26 15:36:00,491 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateProviderImpl] Received request for transactions from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 for segments [38, 36, 47, 44, 45] of cache dist with topology id 8 2013-03-26 15:36:00,491 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateProviderImpl] Transactions were requested by node ConcurrentNonOverlappingLeaveTest-NodeG-31669 with topology 8, greater than the local topology (7). Waiting for topology 8 to be installed locally. 2013-03-26 15:36:00,491 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.statetransfer.StateTransferLockImpl] Waiting for topology 8 to be installed, current topology is 7 2013-03-26 15:36:01,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:01,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:01,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:01,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:02,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:02,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:02,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:02,263 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:03,141 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:03,141 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:03,262 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:03,262 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:04,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:04,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:04,260 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:04,260 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:05,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:05,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:05,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:05,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:06,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:06,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:06,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:06,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:07,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:07,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:07,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:07,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:08,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:08,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:08,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:08,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:09,088 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:09,088 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:09,258 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:09,258 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:10,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:10,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:10,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:10,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:11,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:11,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:11,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:11,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:12,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:12,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:12,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:12,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:13,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:13,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:13,258 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:13,258 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:14,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:14,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:14,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:14,257 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:15,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:15,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:15,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:15,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:36:16,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:16,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 1 transactions were removed, total duration was 0 millis, current number of completed transactions is 0 2013-03-26 15:36:16,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:36:16,256 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 1 transactions were removed, total duration was 0 millis, current number of completed transactions is 0 2013-03-26 15:37:00,441 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796, retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2013-03-26 15:37:00,447 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeF-11796, retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2013-03-26 15:40:00,442 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.rpc.RpcManagerImpl] replication exception: 2013-03-26 15:40:00,442 WARN (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000209: Failed to retrieve transactions for segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeH-5050 (node will not be retried) 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 34 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 35 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 32 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 33 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 48 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 39 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 37 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 46 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 31 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 30 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 31 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 30 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 34 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 35 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 32 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 33 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 39 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 37 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 46 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 48 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,442 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished adding inbound state transfer for segments [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] of cache dist 2013-03-26 15:40:00,442 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = true, pending CH = DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]} 2013-03-26 15:40:00,442 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 8 2013-03-26 15:40:00,442 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished receiving of segments for cache dist for topology 8. 2013-03-26 15:40:00,442 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], remote transactions: 0 2013-03-26 15:40:00,442 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,443 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,443 DEBUG (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,443 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Minimum topology ID still is 7; nothing to change 2013-03-26 15:40:00,443 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Finished local rebalance for cache dist on node ConcurrentNonOverlappingLeaveTest-NodeE-28744, topology id = 8 2013-03-26 15:40:00,443 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,443 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.RebalanceConfirmationCollector] Rebalance confirmation collector 8@dist received confirmation for ConcurrentNonOverlappingLeaveTest-NodeE-28744, remaining list is [ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,443 ERROR (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Failed to start rebalance: org.infinispan.util.concurrent.TimeoutException: Replication timeout for ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 1 0, 32: 0 1, 33: 1 0, 34: 0 1, 35: 1 0, 36: 0 1, 37: 1 0, 38: 0 1, 39: 1 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 1 0, 32: 0 1, 33: 1 0, 34: 0 1, 35: 1 0, 36: 0 1, 37: 1 0, 38: 0 1, 39: 1 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} on cache dist 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 9 is installed 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.rpc.RpcManagerImpl] replication exception: 2013-03-26 15:40:00,443 WARN (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000209: Failed to retrieve transactions for segments [38, 36, 47, 44, 45] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeH-5050 (node will not be retried) 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 38 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 46, 47, 44, 45, 48]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48]; added segments: [38, 36, 47, 44, 45] 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 36 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 47 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 46, 47, 44, 45, 48] or [] for cache dist 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 44 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Adding inbound state transfer for segments [38, 36, 47, 44, 45] of cache dist 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 45 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Requesting transactions for segments [38, 36, 47, 44, 45] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 38 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 36 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=9, segments=[38, 36, 47, 44, 45]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 47 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=9, segments=[38, 36, 47, 44, 45]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeG-31669] with response mode GET_ALL 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 44 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,443 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] ISPN000208: No live owners found for segment 45 of cache dist. Current owners are: [ConcurrentNonOverlappingLeaveTest-NodeH-5050]. Faulty owners: [ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,444 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished adding inbound state transfer for segments [0, 2, 4, 6, 8, 38, 36, 47, 44, 45] of cache dist 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = true, pending CH = DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050]} 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 8 2013-03-26 15:40:00,444 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Requesting segments [0, 2, 4, 6, 8] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], remote transactions: 0 2013-03-26 15:40:00,444 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=8, segments=[0, 2, 4, 6, 8]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,444 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=9, segments=[38, 36, 47, 44, 45]} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,444 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=8, segments=[0, 2, 4, 6, 8]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeE-28744] with response mode GET_ALL 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,444 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 7 to 8 2013-03-26 15:40:00,444 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=9, segments=[38, 36, 47, 44, 45]} 2013-03-26 15:40:00,444 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Received request for transactions from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 for segments [38, 36, 47, 44, 45] of cache dist with topology id 9 2013-03-26 15:40:00,444 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,444 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Transactions were requested by node ConcurrentNonOverlappingLeaveTest-NodeE-28744 with topology 9, greater than the local topology (8). Waiting for topology 9 to be installed locally. 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 1 0, 32: 0 1, 33: 1 0, 34: 0 1, 35: 1 0, 36: 0 1, 37: 1 0, 38: 0 1, 39: 1 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,444 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Waiting for topology 9 to be installed, current topology is 8 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 1 0, 32: 0 1, 33: 1 0, 34: 0 1, 35: 1 0, 36: 0 1, 37: 1 0, 38: 0 1, 39: 1 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 0 1, 45: 0 1, 46: 0 1, 47: 0 1, 48: 0 1, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} on cache dist 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=9, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 9 is installed 2013-03-26 15:40:00,444 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Topology 9 is now installed, expected topology was 9 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] 2013-03-26 15:40:00,444 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Found 0 transaction(s) to transfer 2013-03-26 15:40:00,444 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:40:00,444 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=9, segments=[38, 36, 47, 44, 45]} 2013-03-26 15:40:00,444 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:40:00,444 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Adding inbound state transfer for segments [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] of cache dist 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Requesting transactions for segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=9, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,444 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=9, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeE-28744] with response mode GET_ALL 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, retval=SuccessfulResponse{responseValue=[]} , received=true, suspected=false] 2013-03-26 15:40:00,444 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying 0 transactions for cache dist transferred from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,444 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished adding inbound state transfer for segments [38, 36, 47, 44, 45] of cache dist 2013-03-26 15:40:00,444 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.InboundTransferTask] Requesting segments [38, 36, 47, 44, 45] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = false, pending CH = DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]} 2013-03-26 15:40:00,444 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=9, segments=[38, 36, 47, 44, 45]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 9 2013-03-26 15:40:00,444 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=9, segments=[38, 36, 47, 44, 45]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeG-31669] with response mode GET_ALL 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 0 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,444 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,444 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Minimum topology ID still is 7; nothing to change 2013-03-26 15:40:00,445 TRACE (OOB-7,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=9, segments=[34, 35, 32, 33, 48, 39, 37, 46, 31, 30]} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,445 WARN (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopologyControlCommand] ISPN000071: Caught exception when handling command CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=3} 2013-03-26 15:40:00,445 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=9, segments=[34, 35, 32, 33, 48, 39, 37, 46, 31, 30]} 2013-03-26 15:40:00,445 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Received request for transactions from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 for segments [34, 35, 32, 33, 48, 39, 37, 46, 31, 30] of cache dist with topology id 9 2013-03-26 15:40:00,445 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Found 0 transaction(s) to transfer 2013-03-26 15:40:00,445 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=9, segments=[34, 35, 32, 33, 48, 39, 37, 46, 31, 30]} 2013-03-26 15:40:00,445 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=9, segments=[38, 36, 47, 44, 45]} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,445 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=8, segments=[0, 2, 4, 6, 8]} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,445 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=8, segments=[0, 2, 4, 6, 8]} 2013-03-26 15:40:00,445 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Starting outbound transfer of segments [0, 2, 4, 6, 8] to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 with topology id 8 for cache dist 2013-03-26 15:40:00,445 WARN (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] ISPN000212: Segments were requested by node ConcurrentNonOverlappingLeaveTest-NodeG-31669 with topology 8, older than the local topology (9) 2013-03-26 15:40:00,445 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Adding outbound transfer of segments [0, 2, 4, 6, 8] to ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,446 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=8, segments=[0, 2, 4, 6, 8]} 2013-03-26 15:40:00,446 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] No cache store or the cache store is shared, no need to send any stored cache entries for segments: [0, 2, 4, 6, 8] 2013-03-26 15:40:00,446 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] Sending last chunk containing 0 cache entries from segments [0, 2, 4, 6, 8] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,446 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:40:00,446 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} to single recipient ConcurrentNonOverlappingLeaveTest-NodeG-31669 with response mode GET_ALL 2013-03-26 15:40:00,446 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=9, segments=[38, 36, 47, 44, 45]} 2013-03-26 15:40:00,446 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Starting outbound transfer of segments [38, 36, 47, 44, 45] to node ConcurrentNonOverlappingLeaveTest-NodeE-28744 with topology id 9 for cache dist 2013-03-26 15:40:00,446 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Adding outbound transfer of segments [38, 36, 47, 44, 45] to ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,447 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.LocalTopologyManagerImpl] Error sending the leave request for cache dist to coordinator 2013-03-26 15:40:00,447 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.xsite.BackupReceiverRepositoryImpl] Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'dist' 2013-03-26 15:40:00,447 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.manager.DefaultCacheManager] Stopping cache manager ISPN on ConcurrentNonOverlappingLeaveTest-NodeF-11796 2013-03-26 15:40:00,447 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeF-11796 2013-03-26 15:40:00,447 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000080: Disconnecting and closing JGroups Channel 2013-03-26 15:40:00,447 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, retval=SuccessfulResponse{responseValue=true} , received=true, suspected=false] 2013-03-26 15:40:00,447 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Successfully requested segments [0, 2, 4, 6, 8] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,447 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} 2013-03-26 15:40:00,447 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Before applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 0 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 0 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 0 of cache dist 2013-03-26 15:40:00,448 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=9, segments=[38, 36, 47, 44, 45]} 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 2 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 2 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 2 of cache dist 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 4 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 4 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 4 of cache dist 2013-03-26 15:40:00,448 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, retval=SuccessfulResponse{responseValue=true} , received=true, suspected=false] 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 6 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,448 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.InboundTransferTask] Successfully requested segments [38, 36, 47, 44, 45] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 6 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 6 of cache dist 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 8 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,448 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.OutboundTransferTask] No cache store or the cache store is shared, no need to send any stored cache entries for segments: [38, 36, 47, 44, 45] 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 8 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 8 of cache dist 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Finished receiving state for segments [0, 2, 4, 6, 8] of cache dist 2013-03-26 15:40:00,448 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, retval=SuccessfulResponse{responseValue=[]} , received=true, suspected=false] 2013-03-26 15:40:00,448 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying 0 transactions for cache dist transferred from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished adding inbound state transfer for segments [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] of cache dist 2013-03-26 15:40:00,448 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = false, pending CH = DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]} 2013-03-26 15:40:00,448 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 9 2013-03-26 15:40:00,448 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 0 2013-03-26 15:40:00,448 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,448 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,448 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,448 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 8 to 9 2013-03-26 15:40:00,448 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.OutboundTransferTask] Sending last chunk containing 0 cache entries from segments [38, 36, 47, 44, 45] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Completion of inbound transfer task: InboundTransferTask{segments=[0, 2, 4, 6, 8], finishedSegments=[0, 2, 4, 6, 8], unfinishedSegments=[], source=ConcurrentNonOverlappingLeaveTest-NodeE-28744, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=8, timeout=240000, cacheName=dist} 2013-03-26 15:40:00,448 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=9}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:40:00,448 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Requesting segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,448 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=9} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_ALL 2013-03-26 15:40:00,448 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=9, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,448 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=9, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeE-28744] with response mode GET_ALL 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] After applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Segments not received yet for cache dist: {ConcurrentNonOverlappingLeaveTest-NodeE-28744=[InboundTransferTask{segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30], finishedSegments=[], unfinishedSegments=[34, 35, 32, 33, 48, 39, 37, 46, 31, 30], source=ConcurrentNonOverlappingLeaveTest-NodeE-28744, isCancelled=false, isStartedSuccessfully=false, isCompletedSuccessfully=false, topologyId=9, timeout=240000, cacheName=dist}]} 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} 2013-03-26 15:40:00,448 TRACE (OOB-6,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=9, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=9, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]} 2013-03-26 15:40:00,448 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=9} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Starting outbound transfer of segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 with topology id 9 for cache dist 2013-03-26 15:40:00,448 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:40:00,448 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Adding outbound transfer of segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] to ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,449 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] Outbound transfer of segments [0, 2, 4, 6, 8] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 is complete 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=9, segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30]} 2013-03-26 15:40:00,449 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Removing completed outbound transfer of segments [0, 2, 4, 6, 8] to ConcurrentNonOverlappingLeaveTest-NodeG-31669 for cache dist 2013-03-26 15:40:00,449 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] No cache store or the cache store is shared, no need to send any stored cache entries for segments: [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] 2013-03-26 15:40:00,449 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] Sending last chunk containing 0 cache entries from segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,449 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:40:00,449 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, retval=SuccessfulResponse{responseValue=true} , received=true, suspected=false] 2013-03-26 15:40:00,449 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} to single recipient ConcurrentNonOverlappingLeaveTest-NodeG-31669 with response mode GET_ALL 2013-03-26 15:40:00,449 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Successfully requested segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=9} 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Before applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,449 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 38 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 38 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Before applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 38 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 34 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 36 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 34 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 36 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 34 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 36 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 35 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 47 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 35 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 47 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 35 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 47 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 32 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 44 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 32 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 44 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 32 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 44 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 48 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 45 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 48 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 45 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 48 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 45 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 33 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.InboundTransferTask] Finished receiving state for segments [38, 36, 47, 44, 45] of cache dist 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 33 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Completion of inbound transfer task: InboundTransferTask{segments=[38, 36, 47, 44, 45], finishedSegments=[38, 36, 47, 44, 45], unfinishedSegments=[], source=ConcurrentNonOverlappingLeaveTest-NodeG-31669, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=9, timeout=240000, cacheName=dist} 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 33 of cache dist 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] After applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 39 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Segments not received yet for cache dist: {} 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 39 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=9} 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 39 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 37 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 37 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 37 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 46 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 46 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 46 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 31 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 31 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 31 of cache dist 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 30 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,449 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 30 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,449 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 30 of cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Finished receiving state for segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Completion of inbound transfer task: InboundTransferTask{segments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30], finishedSegments=[34, 35, 32, 48, 33, 39, 37, 46, 31, 30], unfinishedSegments=[], source=ConcurrentNonOverlappingLeaveTest-NodeE-28744, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=9, timeout=240000, cacheName=dist} 2013-03-26 15:40:00,450 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:40:00,450 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished receiving of segments for cache dist for topology 9. 2013-03-26 15:40:00,450 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.OutboundTransferTask] Outbound transfer of segments [38, 36, 47, 44, 45] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeE-28744 is complete 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=9, currentCH=null, pendingCH=null, throwable=null, viewId=3}, mode=ASYNCHRONOUS_WITH_SYNC_MARSHALLING, timeout=0 2013-03-26 15:40:00,450 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Removing completed outbound transfer of segments [38, 36, 47, 44, 45] to ConcurrentNonOverlappingLeaveTest-NodeE-28744 for cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=9, currentCH=null, pendingCH=null, throwable=null, viewId=3} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_NONE 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] After applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Segments not received yet for cache dist: {} 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=9} 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=9, currentCH=null, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,450 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Finished local rebalance for cache dist on node ConcurrentNonOverlappingLeaveTest-NodeG-31669, topology id = 9 2013-03-26 15:40:00,450 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.RebalanceConfirmationCollector] Rebalance confirmation collector 8@dist received confirmation for ConcurrentNonOverlappingLeaveTest-NodeG-31669, remaining list is [] 2013-03-26 15:40:00,450 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] Outbound transfer of segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 is complete 2013-03-26 15:40:00,450 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Finished cluster-wide rebalance for cache dist, topology id = 9 2013-03-26 15:40:00,450 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Removing completed outbound transfer of segments [34, 35, 32, 48, 33, 39, 37, 46, 31, 30] to ConcurrentNonOverlappingLeaveTest-NodeG-31669 for cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Cache dist topology updated: members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], joiners = [], topology = CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,450 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cluster-wide consistent hash for cache dist, topology = CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,450 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,450 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=3}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 1, 37: 0, 38: 1, 39: 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 1, 45: 1, 46: 0, 47: 1, 48: 0, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,450 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=3} to addresses null with response mode GET_ALL 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} on cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 10 is installed 2013-03-26 15:40:00,450 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[ConcurrentNonOverlappingLeaveTest-NodeF-11796, ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: [38, 36, 47, 44, 45]; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 46, 47, 44, 45, 48]; added segments: [] 2013-03-26 15:40:00,450 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [38, 36, 47, 44, 45] of cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,450 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48] or [38, 36, 47, 44, 45] for cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = false, pending CH = null 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 10 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 0 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,450 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,450 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Minimum topology ID still is 7; nothing to change 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,450 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 1, 37: 0, 38: 1, 39: 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 1, 45: 1, 46: 0, 47: 1, 48: 0, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} on cache dist 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,450 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 10 is installed 2013-03-26 15:40:00,451 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: [31, 30, 34, 35, 32, 33, 39, 37, 46, 48]; new segments: [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [] 2013-03-26 15:40:00,451 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] of cache dist 2013-03-26 15:40:00,451 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] or [31, 30, 34, 35, 32, 33, 39, 37, 46, 48] for cache dist 2013-03-26 15:40:00,451 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = false, pending CH = null 2013-03-26 15:40:00,451 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 10 2013-03-26 15:40:00,451 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 0 2013-03-26 15:40:00,451 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,451 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,451 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,451 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 9 to 10 2013-03-26 15:40:00,451 TRACE (request-thread-3,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=3} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,451 TRACE (request-thread-3,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring consistent hash update 10 for cache dist that doesn't exist locally 2013-03-26 15:40:00,528 DEBUG (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|4] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,528 INFO (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|4] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,528 TRACE (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.util.ClusterIdGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], oldMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, 91b5da31-ebba-3f23-c48c-ebcf098ae895, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], localAddress=ConcurrentNonOverlappingLeaveTest-NodeE-28744, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125904201809920 2013-03-26 15:40:00,528 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Received new cluster view: 4 2013-03-26 15:40:00,528 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cluster members for all the caches. New list is [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,528 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Cluster members updated for cache dist, no leavers detected: cache members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,528 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=91b5da31-ebba-3f23-c48c-ebcf098ae895, received=false, suspected=true] 2013-03-26 15:40:00,528 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] Target node 91b5da31-ebba-3f23-c48c-ebcf098ae895 left during remote call, ignoring 2013-03-26 15:40:00,529 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Cache dist status changed: joiners=[], topology=CacheTopology{id=10, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,529 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Triggering rebalance for cache dist 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Rebalancing consistent hash for cache dist, members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cache dist topology for rebalance: CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 1, 37: 0, 38: 1, 39: 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 1, 45: 1, 46: 0, 47: 1, 48: 0, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 0 1, 5: 0 1, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0 1, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 0 1, 40: 1 0, 41: 1 0, 42: 1 0, 43: 1 0, 44: 1 0, 45: 1 0, 46: 0 1, 47: 1 0, 48: 0 1, 49: 1 0, 50: 1 0, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 1 0, 57: 1 0, 58: 1 0, 59: 1 0 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.RebalanceConfirmationCollector] Initialized rebalance confirmation collector 11@dist, initial list is [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Cache dist status changed: joiners=[], topology=CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Not triggering rebalance for cache dist, a rebalance is already in progress 2013-03-26 15:40:00,529 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Starting cluster-wide rebalance for cache dist, topology = CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,529 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.LocalTopologyManagerImpl] Starting local rebalance for cache dist, topology = CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,529 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=4}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 1, 37: 0, 38: 1, 39: 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 1, 45: 1, 46: 0, 47: 1, 48: 0, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,529 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=4} to addresses null with response mode GET_ALL 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 0 1, 5: 0 1, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0 1, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 0 1, 40: 1 0, 41: 1 0, 42: 1 0, 43: 1 0, 44: 1 0, 45: 1 0, 46: 0 1, 47: 1 0, 48: 0 1, 49: 1 0, 50: 1 0, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 1 0, 57: 1 0, 58: 1 0, 59: 1 0 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} on cache dist 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = true, topology = CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 11 is installed 2013-03-26 15:40:00,529 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48]; added segments: [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] 2013-03-26 15:40:00,529 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:40:00,529 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:40:00,529 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Adding inbound state transfer for segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Requesting transactions for segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,529 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeG-31669] with response mode GET_ALL 2013-03-26 15:40:00,529 TRACE (OOB-3,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,529 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} 2013-03-26 15:40:00,529 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Received request for transactions from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 for segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist with topology id 11 2013-03-26 15:40:00,529 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Transactions were requested by node ConcurrentNonOverlappingLeaveTest-NodeE-28744 with topology 11, greater than the local topology (10). Waiting for topology 11 to be installed locally. 2013-03-26 15:40:00,530 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Waiting for topology 11 to be installed, current topology is 10 2013-03-26 15:40:00,530 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=4} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,530 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Received a cache topology command with a higher view id: 4, our view id is 3 2013-03-26 15:40:00,530 TRACE (request-thread-3,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=REBALANCE_START, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, throwable=null, viewId=4} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,530 TRACE (request-thread-3,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.LocalTopologyManagerImpl] Received a cache topology command with a higher view id: 4, our view id is 3 2013-03-26 15:40:00,558 DEBUG (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|4] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,558 DEBUG (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|4] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,558 INFO (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|4] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,558 INFO (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|4] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050] 2013-03-26 15:40:00,558 TRACE (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.util.ClusterIdGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], oldMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, 91b5da31-ebba-3f23-c48c-ebcf098ae895, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], localAddress=ConcurrentNonOverlappingLeaveTest-NodeG-31669, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125908496777216 2013-03-26 15:40:00,558 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.ClusterTopologyManagerImpl] Received new cluster view: 4 2013-03-26 15:40:00,558 TRACE (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeH-5050) [org.infinispan.util.ClusterIdGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], oldMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, 91b5da31-ebba-3f23-c48c-ebcf098ae895, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], localAddress=ConcurrentNonOverlappingLeaveTest-NodeH-5050, viewId=4, subgroupsMerged=null, mergeView=false} and result was 1125912791744512 2013-03-26 15:40:00,559 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.ClusterTopologyManagerImpl] Received new cluster view: 4 2013-03-26 15:40:00,630 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Starting local rebalance for cache dist, topology = CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0, 2: 0 1, 3: 0, 4: 0 1, 5: 0, 6: 0 1, 7: 0, 8: 0 1, 9: 0, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 0 1, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 1, 37: 0, 38: 1, 39: 0, 40: 1, 41: 1, 42: 1, 43: 1, 44: 1, 45: 1, 46: 0, 47: 1, 48: 0, 49: 1, 50: 1, 51: 1, 52: 1, 53: 1, 54: 1, 55: 1, 56: 1, 57: 1, 58: 1, 59: 1 2013-03-26 15:40:00,630 TRACE (request-thread-3,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring rebalance 11 for cache dist that doesn't exist locally 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Pending consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 0 1, 5: 0 1, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0 1, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 0 1, 40: 1 0, 41: 1 0, 42: 1 0, 43: 1 0, 44: 1 0, 45: 1 0, 46: 0 1, 47: 1 0, 48: 0 1, 49: 1 0, 50: 1 0, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 1 0, 57: 1 0, 58: 1 0, 59: 1 0 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} on cache dist 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = true, topology = CacheTopology{id=11, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}} 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 11 is installed 2013-03-26 15:40:00,630 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Topology 11 is now installed, expected topology was 11 2013-03-26 15:40:00,630 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Found 0 transaction(s) to transfer 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [0, 2, 4, 6, 8, 10, 11, 12, 13, 14, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [1, 3, 5, 7, 9, 15, 17, 16, 19, 18, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48] 2013-03-26 15:40:00,630 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=[]} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=GET_TRANSACTIONS, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} 2013-03-26 15:40:00,630 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:40:00,630 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:40:00,630 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Adding inbound state transfer for segments [1, 3, 5, 7, 9, 15, 17, 16, 19, 18, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48] of cache dist 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Requesting transactions for segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,630 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, retval=SuccessfulResponse{responseValue=[]} , received=true, suspected=false] 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,630 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying 0 transactions for cache dist transferred from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,630 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeE-28744] with response mode GET_ALL 2013-03-26 15:40:00,630 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished adding inbound state transfer for segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist 2013-03-26 15:40:00,630 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = true, pending CH = DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]} 2013-03-26 15:40:00,630 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.InboundTransferTask] Requesting segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,630 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 11 2013-03-26 15:40:00,630 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,630 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 0 2013-03-26 15:40:00,630 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeG-31669] with response mode GET_ALL 2013-03-26 15:40:00,630 TRACE (OOB-7,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 18, 48, 31, 30]} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,630 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,630 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,630 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 18, 48, 31, 30]} 2013-03-26 15:40:00,630 DEBUG (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,630 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Received request for transactions from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 for segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 18, 48, 31, 30] of cache dist with topology id 11 2013-03-26 15:40:00,630 TRACE (transport-thread-1,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Minimum topology ID still is 7; nothing to change 2013-03-26 15:40:00,630 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Found 1 transaction(s) to transfer 2013-03-26 15:40:00,630 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,630 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=[TransactionInfo{globalTransaction=GlobalTransaction::28977:local, topologyId=7, modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lockedKeys=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}]}]} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=GET_TRANSACTIONS, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 18, 48, 31, 30]} 2013-03-26 15:40:00,630 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} 2013-03-26 15:40:00,630 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Starting outbound transfer of segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] to node ConcurrentNonOverlappingLeaveTest-NodeE-28744 with topology id 11 for cache dist 2013-03-26 15:40:00,630 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Adding outbound transfer of segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] to ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,631 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, type=START_STATE_TRANSFER, topologyId=11, segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56]} 2013-03-26 15:40:00,631 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.OutboundTransferTask] No cache store or the cache store is shared, no need to send any stored cache entries for segments: [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] 2013-03-26 15:40:00,631 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.OutboundTransferTask] Sending last chunk containing 1 cache entries from segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,631 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, retval=SuccessfulResponse{responseValue=true} , received=true, suspected=false] 2013-03-26 15:40:00,631 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=11}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:40:00,631 TRACE (transport-thread-3,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.InboundTransferTask] Successfully requested segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,631 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=11} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_ALL 2013-03-26 15:40:00,631 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, retval=SuccessfulResponse{responseValue=[TransactionInfo{globalTransaction=GlobalTransaction::28977:local, topologyId=7, modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lockedKeys=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}]}]} , received=true, suspected=false] 2013-03-26 15:40:00,631 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying 1 transactions for cache dist transferred from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,631 TRACE (OOB-7,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=11} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,631 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Created and registered remote transaction RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={}, lockedKeys=null, backupKeyLocks=null, missingLookedUpEntries=false, isMarkedForRollback=false, tx=GlobalTransaction::28977:local} 2013-03-26 15:40:00,631 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=11} 2013-03-26 15:40:00,631 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Before applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,631 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished adding inbound state transfer for segments [1, 3, 5, 7, 9, 15, 17, 16, 19, 18, 31, 30, 34, 35, 32, 33, 39, 37, 46, 48] of cache dist 2013-03-26 15:40:00,631 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 56 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 1 cache entries 2013-03-26 15:40:00,631 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Requesting segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,631 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30]}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=240000 2013-03-26 15:40:00,631 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30]} to addresses [ConcurrentNonOverlappingLeaveTest-NodeE-28744] with response mode GET_ALL 2013-03-26 15:40:00,631 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = true, pending CH = DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]} 2013-03-26 15:40:00,631 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}] for segment 56 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,631 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 11 2013-03-26 15:40:00,631 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@520e9771] 2013-03-26 15:40:00,631 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 1 2013-03-26 15:40:00,631 TRACE (OOB-7,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30]} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,631 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} 2013-03-26 15:40:00,631 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30]} 2013-03-26 15:40:00,631 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Starting outbound transfer of segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 with topology id 11 for cache dist 2013-03-26 15:40:00,631 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking transaction GlobalTransaction::28977:local 2013-03-26 15:40:00,631 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Adding outbound transfer of segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] to ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,631 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@714b 2013-03-26 15:40:00,631 TRACE (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=true} for command StateRequestCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, type=START_STATE_TRANSFER, topologyId=11, segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30]} 2013-03-26 15:40:00,631 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,632 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] No cache store or the cache store is shared, no need to send any stored cache entries for segments: [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] 2013-03-26 15:40:00,631 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.tm.DummyTransaction] registering synchronization handler SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@714b} org.infinispan.transaction.synchronization.SynchronizationAdapter@716a 2013-03-26 15:40:00,632 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, retval=SuccessfulResponse{responseValue=true} , received=true, suspected=false] 2013-03-26 15:40:00,632 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] Sending last chunk containing 1 cache entries from segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.EntryWrappingInterceptor] Skipping ownership check and wrapping key MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 1 2013-03-26 15:40:00,632 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], command=StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=11}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:40:00,632 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Successfully requested segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:40:00,632 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=11} to single recipient ConcurrentNonOverlappingLeaveTest-NodeG-31669 with response mode GET_ALL 2013-03-26 15:40:00,632 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.EntryWrappingInterceptor] The return value is null 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 10 to 11 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.LocalTransaction] Adding modification PutKeyValueCommand{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. Mod list is null 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.tm.DummyTransaction] processing beforeCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714b} org.infinispan.transaction.synchronization.SynchronizationAdapter@716a 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.synchronization.SynchronizationAdapter] beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714b 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionCoordinator] Sending prepare command through the chain: PrepareCommand {modifications=null, onePhaseCommit=false, gtx=GlobalTransaction::29003:local, cacheName='dist', topologyId=-1} 2013-03-26 15:40:00,632 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050, retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2013-03-26 15:40:00,632 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=11} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=null, onePhaseCommit=false, gtx=GlobalTransaction::29003:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6dcef6a] 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=11} 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=null, onePhaseCommit=false, gtx=GlobalTransaction::29003:local, cacheName='dist', topologyId=-1} 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Before applying the received state the data container of cache dist has 2 keys 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:40:00,632 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 7 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 1 cache entries 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? false. hasModifications=false, hasRemoteLocksAcquired=false 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}] for segment 7 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=11, localTopologyId=11 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@12ea1bab] 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.tm.DummyTransaction] processing afterCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714b} org.infinispan.transaction.synchronization.SynchronizationAdapter@716a 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true} 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.synchronization.SynchronizationAdapter] afterCompletion(3) called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714b. 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Created a new local transaction: LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@714c 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionCoordinator] Committing transaction GlobalTransaction::29003:local 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.tm.DummyTransaction] registering synchronization handler SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=false} org.infinispan.transaction.synchronization.SyncLocalTransaction@714c} org.infinispan.transaction.synchronization.SynchronizationAdapter@716b 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::29003:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@47be8140] 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.EntryWrappingInterceptor] Skipping ownership check and wrapping key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::29003:local, cacheName='dist', topologyId=-1} 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? false. hasModifications=false, hasRemoteLocksAcquired=false 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Retrieved from container null 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Creating new entry. 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(2c17b58c){key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=v4, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.EntryWrappingInterceptor] The return value is null 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050} removed=false valid=true changed=true created=true loaded=false value=v4] 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.LocalTransaction] Adding modification PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, flags=[CACHE_MODE_LOCAL, SKIP_REMOTE_LOOKUP, PUT_FOR_STATE_TRANSFER, SKIP_SHARED_CACHE_STORE, SKIP_OWNERSHIP_CHECK, IGNORE_RETURN_VALUES, SKIP_XSITE_BACKUP], putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. Mod list is null 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.AbstractCacheTransaction] Clearing locked keys: null 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.tm.DummyTransaction] processing beforeCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714c} org.infinispan.transaction.synchronization.SynchronizationAdapter@716b 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=11, localTopologyId=11 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.synchronization.SynchronizationAdapter] beforeCompletion called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714c 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Removed LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714b from transaction table. 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionCoordinator] Sending prepare command through the chain: PrepareCommand {modifications=null, onePhaseCommit=false, gtx=GlobalTransaction::29004:local, cacheName='dist', topologyId=-1} 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::29003:local has completed, notifying listening threads. 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=null, onePhaseCommit=false, gtx=GlobalTransaction::29004:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@489010f1] 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 56 of cache dist 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=null, onePhaseCommit=false, gtx=GlobalTransaction::29004:local, cacheName='dist', topologyId=-1} 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 38 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? false. hasModifications=false, hasRemoteLocksAcquired=false 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 38 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=false 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 38 of cache dist 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=11, localTopologyId=11 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 36 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.tm.DummyTransaction] processing afterCompletion for SynchronizationAdapter{localTransaction=LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714c} org.infinispan.transaction.synchronization.SynchronizationAdapter@716b 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 36 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.synchronization.SynchronizationAdapter] afterCompletion(3) called for LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714c. 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 36 of cache dist 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionCoordinator] Committing transaction GlobalTransaction::29004:local 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 42 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 42 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::29004:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@6a48636e] 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 42 of cache dist 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::29004:local, cacheName='dist', topologyId=-1} 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 43 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.distribution.BaseDistributionInterceptor] Should invoke remotely? false. hasModifications=false, hasRemoteLocksAcquired=false 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 43 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 43 of cache dist 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(36780145){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=v1, oldValue=null, isCreated=true, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 40 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} removed=false valid=true changed=true created=true loaded=false value=v1] 2013-03-26 15:40:00,632 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 40 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,632 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.AbstractCacheTransaction] Clearing locked keys: null 2013-03-26 15:40:00,632 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 40 of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] CommandTopologyId=11, localTopologyId=11 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 41 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Removed LocalTransaction{remoteLockedNodes=null, isMarkedForRollback=false, lockedKeys=null, backupKeyLocks=null, topologyId=11, isFromStateTransfer=true} org.infinispan.transaction.synchronization.SyncLocalTransaction@714c from transaction table. 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 41 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::29004:local has completed, notifying listening threads. 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 41 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 7 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 47 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 34 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 47 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 34 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 47 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 34 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 44 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 44 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 35 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 44 of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 35 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 35 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 45 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 1 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 45 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 1 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 45 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 1 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 51 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 51 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 32 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 51 of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 32 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 32 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 50 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 33 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 50 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 33 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 50 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 33 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 49 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 3 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 49 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 3 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 49 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 3 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 55 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 55 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 39 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 55 of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 39 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 54 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 39 of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 54 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 54 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 5 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 53 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 5 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 53 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 5 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 53 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 37 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 52 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 37 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 52 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 37 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 52 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 9 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 59 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 9 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 59 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 9 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 59 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 46 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 58 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 46 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 58 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 46 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 58 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 15 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 57 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 15 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 57 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 15 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 57 of cache dist 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 17 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.InboundTransferTask] Finished receiving state for segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 17 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 17 of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Completion of inbound transfer task: InboundTransferTask{segments=[38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56], finishedSegments=[56, 38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57], unfinishedSegments=[], source=ConcurrentNonOverlappingLeaveTest-NodeG-31669, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=11, timeout=240000, cacheName=dist} 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 16 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Finished receiving of segments for cache dist for topology 11. 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 16 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 16 of cache dist 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] After applying the received state the data container of cache dist has 3 keys 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 19 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Segments not received yet for cache dist: {} 2013-03-26 15:40:00,633 DEBUG (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Finished local rebalance for cache dist on node ConcurrentNonOverlappingLeaveTest-NodeE-28744, topology id = 11 2013-03-26 15:40:00,633 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeG-31669, topologyId=11} 2013-03-26 15:40:00,633 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 19 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,633 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.RebalanceConfirmationCollector] Rebalance confirmation collector 11@dist received confirmation for ConcurrentNonOverlappingLeaveTest-NodeE-28744, remaining list is [ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,633 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 19 of cache dist 2013-03-26 15:40:00,634 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 48 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,634 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.OutboundTransferTask] Outbound transfer of segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeE-28744 is complete 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 48 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,634 TRACE (transport-thread-4,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateProviderImpl] Removing completed outbound transfer of segments [38, 36, 42, 43, 40, 41, 47, 44, 45, 51, 50, 49, 55, 54, 53, 52, 59, 58, 57, 56] to ConcurrentNonOverlappingLeaveTest-NodeE-28744 for cache dist 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 48 of cache dist 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 18 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 18 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 18 of cache dist 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 31 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 31 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 31 of cache dist 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Applying new state for segment 30 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744: received 0 cache entries 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received keys [] for segment 30 of cache dist from node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished applying state for segment 30 of cache dist 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.InboundTransferTask] Finished receiving state for segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] of cache dist 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Completion of inbound transfer task: InboundTransferTask{segments=[34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30], finishedSegments=[7, 34, 35, 1, 32, 33, 3, 39, 5, 37, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30], unfinishedSegments=[], source=ConcurrentNonOverlappingLeaveTest-NodeE-28744, isCancelled=false, isStartedSuccessfully=true, isCompletedSuccessfully=true, topologyId=11, timeout=240000, cacheName=dist} 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Finished receiving of segments for cache dist for topology 11. 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=11, currentCH=null, pendingCH=null, throwable=null, viewId=4}, mode=ASYNCHRONOUS_WITH_SYNC_MARSHALLING, timeout=0 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=11, currentCH=null, pendingCH=null, throwable=null, viewId=4} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_NONE 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] After applying the received state the data container of cache dist has 3 keys 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Segments not received yet for cache dist: {} 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=REBALANCE_CONFIRM, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=11, currentCH=null, pendingCH=null, throwable=null, viewId=4} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command StateResponseCommand{cache=dist, origin=ConcurrentNonOverlappingLeaveTest-NodeE-28744, topologyId=11} 2013-03-26 15:40:00,634 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Finished local rebalance for cache dist on node ConcurrentNonOverlappingLeaveTest-NodeG-31669, topology id = 11 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.RebalanceConfirmationCollector] Rebalance confirmation collector 11@dist received confirmation for ConcurrentNonOverlappingLeaveTest-NodeG-31669, remaining list is [] 2013-03-26 15:40:00,634 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Finished cluster-wide rebalance for cache dist, topology id = 11 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Cache dist topology updated: members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], joiners = [], topology = CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,634 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: null 2013-03-26 15:40:00,634 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cluster-wide consistent hash for cache dist, topology = CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,634 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.OutboundTransferTask] Outbound transfer of segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] of cache dist to node ConcurrentNonOverlappingLeaveTest-NodeG-31669 is complete 2013-03-26 15:40:00,634 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,634 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=4}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 0 1, 5: 0 1, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0 1, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 0 1, 40: 1 0, 41: 1 0, 42: 1 0, 43: 1 0, 44: 1 0, 45: 1 0, 46: 0 1, 47: 1 0, 48: 0 1, 49: 1 0, 50: 1 0, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 1 0, 57: 1 0, 58: 1 0, 59: 1 0 2013-03-26 15:40:00,634 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=4} to addresses null with response mode GET_ALL 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} on cache dist 2013-03-26 15:40:00,634 TRACE (transport-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateProviderImpl] Removing completed outbound transfer of segments [34, 35, 1, 32, 33, 3, 39, 5, 37, 7, 9, 46, 15, 17, 16, 19, 48, 18, 31, 30] to ConcurrentNonOverlappingLeaveTest-NodeG-31669 for cache dist 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 12 is installed 2013-03-26 15:40:00,634 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[ConcurrentNonOverlappingLeaveTest-NodeH-5050, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [] 2013-03-26 15:40:00,634 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:40:00,634 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = false, pending CH = null 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 12 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 0 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:00,634 DEBUG (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,634 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.transaction.TransactionTable] Minimum topology ID still is 7; nothing to change 2013-03-26 15:40:00,634 TRACE (request-thread-3,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=4} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,634 TRACE (request-thread-3,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring consistent hash update 12 for cache dist that doesn't exist locally 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=4} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:00,634 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0 1, 1: 0 1, 2: 0 1, 3: 0 1, 4: 0 1, 5: 0 1, 6: 0 1, 7: 0 1, 8: 0 1, 9: 0 1, 10: 0 1, 11: 0 1, 12: 0 1, 13: 0 1, 14: 0 1, 15: 0 1, 16: 0 1, 17: 0 1, 18: 0 1, 19: 0 1, 20: 1 0, 21: 1 0, 22: 1 0, 23: 1 0, 24: 1 0, 25: 1 0, 26: 1 0, 27: 1 0, 28: 1 0, 29: 1 0, 30: 0 1, 31: 0 1, 32: 0 1, 33: 0 1, 34: 0 1, 35: 0 1, 36: 1 0, 37: 0 1, 38: 1 0, 39: 0 1, 40: 1 0, 41: 1 0, 42: 1 0, 43: 1 0, 44: 1 0, 45: 1 0, 46: 0 1, 47: 1 0, 48: 0 1, 49: 1 0, 50: 1 0, 51: 1 0, 52: 1 0, 53: 1 0, 54: 1 0, 55: 1 0, 56: 1 0, 57: 1 0, 58: 1 0, 59: 1 0 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} on cache dist 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,634 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 12 is installed 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [] 2013-03-26 15:40:00,635 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:40:00,635 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = true, isRebalance = false, pending CH = null 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 12 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 1 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking transaction GlobalTransaction::28977:local 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 1 2013-03-26 15:40:00,635 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:00,635 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Minimum topology ID still is 11; nothing to change 2013-03-26 15:40:00,635 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeH-5050, retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2013-03-26 15:40:00,635 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Cache dist status changed: joiners=[], topology=CacheTopology{id=12, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:00,635 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.DefaultRebalancePolicy] Not triggering rebalance for cache dist, no joiners and the current consistent hash is already balanced 2013-03-26 15:40:00,859 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.fwk.TEST_PING] Stop discovery for 91b5da31-ebba-3f23-c48c-ebcf098ae895 2013-03-26 15:40:00,859 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher 2013-03-26 15:40:00,859 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.manager.DefaultCacheManager] Stopping cache manager ISPN on ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:40:00,859 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:40:00,859 DEBUG (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring consistent hash update 10 for cache dist, the local cache manager is not running 2013-03-26 15:40:00,860 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000080: Disconnecting and closing JGroups Channel 2013-03-26 15:40:00,860 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeF) [org.jgroups.blocks.RequestCorrelator] failed marshalling rsp (SuccessfulResponse{responseValue=null} ): java.lang.NullPointerException 2013-03-26 15:40:00,890 DEBUG (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|5] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,890 INFO (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|5] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,890 TRACE (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeE-28744) [org.infinispan.util.ClusterIdGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], oldMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], localAddress=ConcurrentNonOverlappingLeaveTest-NodeE-28744, viewId=5, subgroupsMerged=null, mergeView=false} and result was 1407379178520576 2013-03-26 15:40:00,890 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Received new cluster view: 5 2013-03-26 15:40:00,890 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cluster members for all the caches. New list is [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,890 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Cluster members updated for cache dist, no leavers detected: cache members = [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,920 DEBUG (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|5] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,920 INFO (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [ConcurrentNonOverlappingLeaveTest-NodeE-28744|5] [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:00,920 TRACE (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.util.ClusterIdGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], oldMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669, ConcurrentNonOverlappingLeaveTest-NodeH-5050], localAddress=ConcurrentNonOverlappingLeaveTest-NodeG-31669, viewId=5, subgroupsMerged=null, mergeView=false} and result was 1407383473487872 2013-03-26 15:40:00,920 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.ClusterTopologyManagerImpl] Received new cluster view: 5 2013-03-26 15:40:01,221 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.fwk.TEST_PING] Stop discovery for ConcurrentNonOverlappingLeaveTest-NodeH-5050 2013-03-26 15:40:01,221 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher 2013-03-26 15:40:01,222 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] Exception executing command 2013-03-26 15:40:01,222 ERROR (request-thread-0,ConcurrentNonOverlappingLeaveTest-NodeH) [org.jgroups.blocks.RequestCorrelator] failed marshalling rsp (ExceptionResponse): java.lang.NullPointerException 2013-03-26 15:40:01,222 TRACE (Updater) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28977:local, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.LocalTxInvocationContext@731559e9] 2013-03-26 15:40:01,222 ERROR (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeH) [org.infinispan.remoting.InboundInvocationHandlerImpl] Exception executing command 2013-03-26 15:40:01,222 TRACE (Updater) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeE-28744 broadcasting call CommitCommand {gtx=GlobalTransaction::28977:local, cacheName='dist', topologyId=12} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:01,222 ERROR (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeH) [org.jgroups.blocks.RequestCorrelator] failed marshalling rsp (ExceptionResponse): java.lang.NullPointerException 2013-03-26 15:40:01,222 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: CommitCommand {gtx=GlobalTransaction::28977:local, cacheName='dist', topologyId=12} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:01,222 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on CommitCommand {gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=12} 2013-03-26 15:40:01,222 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.commands.tx.AbstractTransactionBoundaryCommand] About to execute tx command CommitCommand {gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=12} 2013-03-26 15:40:01,222 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command CommitCommand {gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=12} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@2f2a7aa3] 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] Replaying the transactions received as a result of state transfer PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=-1} 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.commands.tx.PrepareCommand] Invoking remotely originated prepare: PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=-1} with invocation context: org.infinispan.context.impl.RemoteTxInvocationContext@2f2a7aa3 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=-1} and InvocationContext [org.infinispan.context.impl.RemoteTxInvocationContext@2f2a7aa3] 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command PrepareCommand {modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], onePhaseCommit=false, gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=-1} 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.locking.OptimisticLockingInterceptor] Not using lock reordering as we have a single key. 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=ImmortalCacheValue {value=v1}} 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.RemoteTransaction] Adding key MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} to tx GlobalTransaction::28977:remote 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Executing command: PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}. 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handlePrepareCommand. 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.TxInterceptor] invokeNextInterceptorAndVerifyTransaction :: originatorMissing=false, alreadyCompleted=true 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.TxInterceptor] Rolling back remote transaction GlobalTransaction::28977:remote because either already completed(true) or originator no longer in the cluster(false). 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleRollbackCommand. 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.AbstractCacheTransaction] Clearing locked keys: null 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Removed remote transaction GlobalTransaction::28977:remote ? RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}=ReadCommittedEntry(6205e9de){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, oldValue=v1, isCreated=false, isChanged=true, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}], missingLookedUpEntries=false, isMarkedForRollback=true, tx=GlobalTransaction::28977:remote} 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 11 to 12 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Removed RemoteTransaction{modifications=[PutKeyValueCommand{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, flags=null, putIfAbsent=false, lifespanMillis=-1, maxIdleTimeMillis=-1, successful=true}], lookedUpEntries={MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}=ReadCommittedEntry(6205e9de){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, oldValue=v1, isCreated=false, isChanged=true, isRemoved=false, isValid=true}}, lockedKeys=null, backupKeyLocks=[MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}], missingLookedUpEntries=false, isMarkedForRollback=true, tx=GlobalTransaction::28977:remote} from transaction table. 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.AbstractCacheTransaction] Transaction GlobalTransaction::28977:remote has completed, notifying listening threads. 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command CommitCommand {gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=12} 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.CallInterceptor] Suppressing invocation of method handleCommitCommand. 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.interceptors.EntryWrappingInterceptor] About to commit entry ReadCommittedEntry(6205e9de){key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=transactionally_replaced, oldValue=v1, isCreated=false, isChanged=true, isRemoved=false, isValid=true} 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.container.entries.ReadCommittedEntry] Updating entry (key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744} removed=false valid=true changed=true created=false loaded=false value=transactionally_replaced] 2013-03-26 15:40:01,223 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response SuccessfulResponse{responseValue=null} for command CommitCommand {gtx=GlobalTransaction::28977:remote, cacheName='dist', topologyId=12} 2013-03-26 15:40:01,224 TRACE (Updater) [org.infinispan.remoting.rpc.RpcManagerImpl] ConcurrentNonOverlappingLeaveTest-NodeE-28744 broadcasting call TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=-1, gtx=GlobalTransaction::28977:local, cacheName=dist} to recipient list [ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:01,224 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute command: TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=12, gtx=GlobalTransaction::28977:local, cacheName=dist} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:01,224 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.InboundInvocationHandlerImpl] Calling perform() on TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=12, gtx=GlobalTransaction::28977:local, cacheName=dist} 2013-03-26 15:40:01,224 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.commands.remote.recovery.TxCompletionNotificationCommand] Processing completed transaction GlobalTransaction::28977:local 2013-03-26 15:40:01,224 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Removed remote transaction GlobalTransaction::28977:local ? null 2013-03-26 15:40:01,224 TRACE (OOB-5,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.InboundInvocationHandlerImpl] About to send back response null for command TxCompletionNotificationCommand{ xid=null, internalId=0, topologyId=12, gtx=GlobalTransaction::28977:local, cacheName=dist} 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.TestingUtil] Node ConcurrentNonOverlappingLeaveTest-NodeE-28744 finished state transfer. 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.TestingUtil] Node ConcurrentNonOverlappingLeaveTest-NodeG-31669 finished state transfer. 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, flags=null} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@47e77d67] 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command GetKeyValueCommand {key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, flags=null} 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=ImmortalCacheValue {value=transactionally_replaced}} 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: GetKeyValueCommand {key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, flags=null}. 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.commands.read.GetKeyValueCommand] Found value transactionally_replaced 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, flags=null} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@2eda1a12] 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command GetKeyValueCommand {key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, flags=null} 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, value=ImmortalCacheValue {value=transactionally_replaced}} 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: GetKeyValueCommand {key=MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}, flags=null}. 2013-03-26 15:40:01,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.commands.read.GetKeyValueCommand] Found value transactionally_replaced 2013-03-26 15:40:02,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:40:02,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, flags=null} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@28f19168] 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command GetKeyValueCommand {key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, flags=null} 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=ImmortalCacheValue {value=v3}} 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: GetKeyValueCommand {key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, flags=null}. 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.commands.read.GetKeyValueCommand] Found value v3 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, flags=null} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@b8157d8] 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command GetKeyValueCommand {key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, flags=null} 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, value=ImmortalCacheValue {value=v3}} 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: GetKeyValueCommand {key=MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}, flags=null}. 2013-03-26 15:40:02,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.commands.read.GetKeyValueCommand] Found value v3 2013-03-26 15:40:03,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:40:03,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:40:03,324 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, flags=null} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@f2eb74b] 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command GetKeyValueCommand {key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, flags=null} 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=ImmortalCacheValue {value=v4}} 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: GetKeyValueCommand {key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, flags=null}. 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.commands.read.GetKeyValueCommand] Found value v4 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command GetKeyValueCommand {key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, flags=null} and InvocationContext [org.infinispan.context.SingleKeyNonTxInvocationContext@4403a4b6] 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferInterceptor] handleTopologyAffectedCommand for command GetKeyValueCommand {key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, flags=null} 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Exists in context? null 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.container.EntryFactoryImpl] Retrieved from container ImmortalCacheEntry{key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, value=ImmortalCacheValue {value=v4}} 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: GetKeyValueCommand {key=MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}, flags=null}. 2013-03-26 15:40:03,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.commands.read.GetKeyValueCommand] Found value v4 2013-03-26 15:40:04,084 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] About to cleanup completed transaction. Initial size is 1 2013-03-26 15:40:04,085 TRACE (TxCleanupService,dist,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.transaction.TransactionTable] Finished cleaning up completed transactions. 0 transactions were removed, total duration was 0 millis, current number of completed transactions is 1 2013-03-26 15:40:04,325 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Test testTransactional(org.infinispan.distribution.rehash.ConcurrentNonOverlappingLeaveTest) succeeded. 2013-03-26 15:40:04,325 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.fwk.UnitTestTestNGListener] Test suite progress: tests succeeded: 2653, failed: 1, skipped: 0. 2013-03-26 15:40:04,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command EntrySetCommand{set=3 elements} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@42486e33] 2013-03-26 15:40:04,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: EntrySetCommand{set=3 elements}. 2013-03-26 15:40:04,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.TestingUtil] Cache contents on ConcurrentNonOverlappingLeaveTest-NodeE-28744 before stopping: [MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}=v4, MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}=v3, MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}=transactionally_replaced] 2013-03-26 15:40:04,325 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:04,325 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Wait for on-going transactions to finish for 0 milliseconds. 2013-03-26 15:40:04,325 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] All transactions terminated 2013-03-26 15:40:04,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateConsumerImpl] Shutting down StateConsumer of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:04,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateProviderImpl] Shutting down StateProvider of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:04,325 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] Shutting down StateTransferManager of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:04,325 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.LocalTopologyManagerImpl] Node ConcurrentNonOverlappingLeaveTest-NodeE-28744 leaving cache dist 2013-03-26 15:40:04,326 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.ClusterCacheStatus] Removed node ConcurrentNonOverlappingLeaveTest-NodeE-28744 from cache dist: members = [ConcurrentNonOverlappingLeaveTest-NodeG-31669], joiners = [] 2013-03-26 15:40:04,326 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.ClusterCacheStatus] Cache dist topology updated: members = [ConcurrentNonOverlappingLeaveTest-NodeG-31669], joiners = [], topology = CacheTopology{id=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:04,326 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.ClusterTopologyManagerImpl] Cache dist topology updated: CacheTopology{id=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:04,326 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 2013-03-26 15:40:04,326 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.ClusterTopologyManagerImpl] Updating cluster-wide consistent hash for cache dist, topology = CacheTopology{id=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:04,326 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.LocalTopologyManagerImpl] Ignoring consistent hash update 13 for cache dist that doesn't exist locally 2013-03-26 15:40:04,326 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=5}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:40:04,326 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=5} to addresses null with response mode GET_ALL 2013-03-26 15:40:04,326 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] real_dests=[ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=CH_UPDATE, sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744, joinInfo=null, topologyId=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null, throwable=null, viewId=5} [sender=ConcurrentNonOverlappingLeaveTest-NodeE-28744] 2013-03-26 15:40:04,326 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.LocalTopologyManagerImpl] Updating local consistent hash(es) for cache dist: new topology = CacheTopology{id=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.CacheTopology] Current consistent hash's routing table: 0: 0, 1: 0, 2: 0, 3: 0, 4: 0, 5: 0, 6: 0, 7: 0, 8: 0, 9: 0, 10: 0, 11: 0, 12: 0, 13: 0, 14: 0, 15: 0, 16: 0, 17: 0, 18: 0, 19: 0, 20: 0, 21: 0, 22: 0, 23: 0, 24: 0, 25: 0, 26: 0, 27: 0, 28: 0, 29: 0, 30: 0, 31: 0, 32: 0, 33: 0, 34: 0, 35: 0, 36: 0, 37: 0, 38: 0, 39: 0, 40: 0, 41: 0, 42: 0, 43: 0, 44: 0, 45: 0, 46: 0, 47: 0, 48: 0, 49: 0, 50: 0, 51: 0, 52: 0, 53: 0, 54: 0, 55: 0, 56: 0, 57: 0, 58: 0, 59: 0 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferManagerImpl] Installing new cache topology CacheTopology{id=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} on cache dist 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Received new topology for cache dist, isRebalance = false, topology = CacheTopology{id=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling topology 13 is installed 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] On cache dist we have: removed segments: []; new segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; old segments: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56]; added segments: [] 2013-03-26 15:40:04,326 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing state for segments [] of cache dist 2013-03-26 15:40:04,326 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Removing L1 state for segments not in [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 16, 19, 18, 21, 20, 23, 22, 25, 24, 27, 26, 29, 28, 31, 30, 34, 35, 32, 33, 38, 39, 36, 37, 42, 43, 40, 41, 46, 47, 44, 45, 51, 50, 49, 48, 55, 54, 53, 52, 59, 58, 57, 56] or [] for cache dist 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateConsumerImpl] Topology update processed, rebalanceInProgress = false, isRebalance = false, pending CH = null 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.statetransfer.StateTransferLockImpl] Signalling transaction data received for topology 13 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Checking for transactions originated on leavers. Current members are [ConcurrentNonOverlappingLeaveTest-NodeG-31669], remote transactions: 0 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] No global transactions pertain to originator(s) who have left the cluster. 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Completed cleaning transactions originating on leavers. Remote transactions remaining: 0 2013-03-26 15:40:04,326 DEBUG (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Topology changed, recalculating minTopologyId 2013-03-26 15:40:04,326 TRACE (request-thread-1,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.transaction.TransactionTable] Changing minimum topology ID from 12 to 13 2013-03-26 15:40:04,326 TRACE (transport-thread-0,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Responses: [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, retval=SuccessfulResponse{responseValue=null} , received=true, suspected=false] 2013-03-26 15:40:04,326 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.DefaultRebalancePolicy] Cache dist status changed: joiners=[], topology=CacheTopology{id=13, currentCH=DefaultConsistentHash{numSegments=60, numOwners=2, members=[ConcurrentNonOverlappingLeaveTest-NodeG-31669]}, pendingCH=null} 2013-03-26 15:40:04,326 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.DefaultRebalancePolicy] Not triggering rebalance for cache dist, no joiners and the current consistent hash is already balanced 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.xsite.BackupReceiverRepositoryImpl] Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'dist' 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.InvocationContextInterceptor] Invoked with command EntrySetCommand{set=3 elements} and InvocationContext [org.infinispan.context.impl.NonTxInvocationContext@7a336b68] 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.interceptors.CallInterceptor] Executing command: EntrySetCommand{set=3 elements}. 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.TestingUtil] Cache contents on ConcurrentNonOverlappingLeaveTest-NodeG-31669 before stopping: [MagicKey#k4{3e196aaa@ConcurrentNonOverlappingLeaveTest-NodeH-5050}=v4, MagicKey#k3{f0ece67c@ConcurrentNonOverlappingLeaveTest-NodeG-31669}=v3, MagicKey#k1{14904782@ConcurrentNonOverlappingLeaveTest-NodeE-28744}=transactionally_replaced] 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] Wait for on-going transactions to finish for 0 milliseconds. 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.transaction.TransactionTable] All transactions terminated 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateConsumerImpl] Shutting down StateConsumer of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateProviderImpl] Shutting down StateProvider of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.statetransfer.StateTransferManagerImpl] Shutting down StateTransferManager of cache dist on node ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.topology.LocalTopologyManagerImpl] Node ConcurrentNonOverlappingLeaveTest-NodeG-31669 leaving cache dist 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=[ConcurrentNonOverlappingLeaveTest-NodeE-28744], command=CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=5}, mode=SYNCHRONOUS, timeout=240000 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Replication task sending CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=5} to single recipient ConcurrentNonOverlappingLeaveTest-NodeE-28744 with response mode GET_ALL 2013-03-26 15:40:04,327 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Attempting to execute non-CacheRpcCommand command: CacheTopologyControlCommand{cache=dist, type=LEAVE, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=5} [sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:04,327 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Removed node ConcurrentNonOverlappingLeaveTest-NodeG-31669 from cache dist: members = [], joiners = [] 2013-03-26 15:40:04,327 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterCacheStatus] Cache dist topology updated: members = [], joiners = [], topology = CacheTopology{id=14, currentCH=null, pendingCH=null} 2013-03-26 15:40:04,327 TRACE (request-thread-2,ConcurrentNonOverlappingLeaveTest-NodeE) [org.infinispan.topology.ClusterTopologyManagerImpl] Initial topology installed for cache dist: CacheTopology{id=14, currentCH=null, pendingCH=null} 2013-03-26 15:40:04,327 TRACE (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher] Response: SuccessfulResponse{responseValue=null} 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.xsite.BackupReceiverRepositoryImpl] Processing cache stop: EventImpl{type=CACHE_STOPPED, newMembers=null, oldMembers=null, localAddress=null, viewId=0, subgroupsMerged=null, mergeView=false}. Cache name: 'dist' 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.manager.DefaultCacheManager] Stopping cache manager ISPN on ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:04,327 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:04,327 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000080: Disconnecting and closing JGroups Channel 2013-03-26 15:40:04,658 DEBUG (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] New view accepted: [ConcurrentNonOverlappingLeaveTest-NodeG-31669|6] [ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:04,658 INFO (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000094: Received new cluster view: [ConcurrentNonOverlappingLeaveTest-NodeG-31669|6] [ConcurrentNonOverlappingLeaveTest-NodeG-31669] 2013-03-26 15:40:04,658 TRACE (Incoming-1,ISPN,ConcurrentNonOverlappingLeaveTest-NodeG-31669) [org.infinispan.util.ClusterIdGenerator] Calculated rank based on view EventImpl{type=VIEW_CHANGED, newMembers=[ConcurrentNonOverlappingLeaveTest-NodeG-31669], oldMembers=[ConcurrentNonOverlappingLeaveTest-NodeE-28744, ConcurrentNonOverlappingLeaveTest-NodeG-31669], localAddress=ConcurrentNonOverlappingLeaveTest-NodeG-31669, viewId=6, subgroupsMerged=null, mergeView=false} and result was 1688854155231232 2013-03-26 15:40:04,658 TRACE (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.ClusterTopologyManagerImpl] Received new cluster view: 6 2013-03-26 15:40:04,658 DEBUG (notification-thread-0,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.topology.ClusterTopologyManagerImpl] Recovering running caches in the cluster 2013-03-26 15:40:04,659 TRACE (transport-thread-5,ConcurrentNonOverlappingLeaveTest-NodeG) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] dests=null, command=CacheTopologyControlCommand{cache=null, type=GET_STATUS, sender=ConcurrentNonOverlappingLeaveTest-NodeG-31669, joinInfo=null, topologyId=0, currentCH=null, pendingCH=null, throwable=null, viewId=5}, mode=SYNCHRONOUS_IGNORE_LEAVERS, timeout=60000 2013-03-26 15:40:04,689 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.fwk.TEST_PING] Stop discovery for ConcurrentNonOverlappingLeaveTest-NodeE-28744 2013-03-26 15:40:04,689 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher 2013-03-26 15:40:04,689 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.manager.DefaultCacheManager] Stopping cache manager ISPN on ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:04,689 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.CacheImpl] Stopping cache dist on ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:04,689 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000080: Disconnecting and closing JGroups Channel 2013-03-26 15:40:04,690 DEBUG (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.test.fwk.TEST_PING] Stop discovery for ConcurrentNonOverlappingLeaveTest-NodeG-31669 2013-03-26 15:40:04,690 INFO (testng-ConcurrentNonOverlappingLeaveTest) [org.infinispan.remoting.transport.jgroups.JGroupsTransport] ISPN000082: Stopping the RpcDispatcher