Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-8309

StateResponseOrderingTest.testStateResponseWhileRestartingBrokenTransfers failing randomly

This issue belongs to an archived project. You can view it, but you can't modify it. Learn more

    • Icon: Bug Bug
    • Resolution: Obsolete
    • Icon: Major Major
    • None
    • 9.1.0.Final, 11.0.0.Alpha2
    • None

      Error Message
      
      expected:<[StateResponseOrderingTest-NodeC-20453, StateResponseOrderingTest-NodeB-7774, StateResponseOrderingTest-NodeD-65308]> but was:<[StateResponseOrderingTest-NodeB-7774, StateResponseOrderingTest-NodeC-20453, StateResponseOrderingTest-NodeD-65308]>
      Stacktrace
      
            java.lang.AssertionError: expected:<[StateResponseOrderingTest-NodeC-20453, StateResponseOrderingTest-NodeB-7774, StateResponseOrderingTest-NodeD-65308]> but was:<[StateResponseOrderingTest-NodeB-7774, StateResponseOrderingTest-NodeC-20453, StateResponseOrderingTest-NodeD-65308]>
      	at org.infinispan.distribution.rehash.StateResponseOrderingTest.testStateResponseWhileRestartingBrokenTransfers(StateResponseOrderingTest.java:201)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      ... Removed 20 stack frames
      

            [ISPN-8309] StateResponseOrderingTest.testStateResponseWhileRestartingBrokenTransfers failing randomly

            Infinispan issue tracking has been migrated to GitHub issues: https://github.com/infinispan/infinispan/issues
            If you still want this issue to be worked on, create a new issue on GitHub and link this issue.

            Tristan Tarrant added a comment - Infinispan issue tracking has been migrated to GitHub issues: https://github.com/infinispan/infinispan/issues If you still want this issue to be worked on, create a new issue on GitHub and link this issue.

            The test still fails, but the failure is different now, because it's caused by ISPN-8240:

            13:33:30,325 TRACE (non-blocking-thread-Test-NodeA-p9677-t3:[]) [StateConsumerImpl] Received new topology for cache defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=18, phase=READ_OLD_WRITE_ALL, rebalanceId=6, currentCH=DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 0+0, Test-NodeB: 1+1, Test-NodeC: 1+1, Test-NodeD: 0+2]}, pendingCH=DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 2+0, Test-NodeB: 0+2, Test-NodeC: 0+2, Test-NodeD: 0+0]}, unionCH=DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 0+2, Test-NodeB: 1+1, Test-NodeC: 1+1, Test-NodeD: 0+2]}, actualMembers=[Test-NodeA, Test-NodeB, Test-NodeC, Test-NodeD], persistentUUIDs=[a6d4a46a-b6c4-45eb-b989-67edd9c1f626, 226427e7-140e-4fba-b4f4-71fd3ea29e59, 34f57148-f068-4ee0-ba19-332b28d08090, 54f45d82-1b1a-4686-a9e3-0b7e7d34b792]}
            13:33:30,325 TRACE (non-blocking-thread-Test-NodeA-p9677-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false
            13:33:30,325 TRACE (non-blocking-thread-Test-NodeA-p9677-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true
            13:33:30,329 TRACE (jgroups-5,Test-NodeA:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 18, startRebalance = true, pending CH = DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 2+0, Test-NodeB: 0+2, Test-NodeC: 0+2, Test-NodeD: 0+0]}
            13:33:30,330 TRACE (jgroups-5,Test-NodeA:[]) [JGroupsTransport] Test-NodeA received request 12 from Test-NodeC: StateResponseCommand{cache=defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=1, cacheEntries=1, isLastChunk=true}], origin=Test-NodeC, topologyId=18, applyState=true}
            13:33:30,344 TRACE (remote-thread-Test-NodeA-p9678-t2:[defaultcache]) [CommitManager] Committed key=MagicKey#k2{1C0/33BD43A5/1@Test-NodeC}. Old discard policy=null. New discard policy=null
            
            13:33:30,345 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [StateConsumerImpl] Received new topology for cache defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=20, phase=READ_OLD_WRITE_ALL, rebalanceId=7, currentCH=DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 0+0, Test-NodeC: 2+0, Test-NodeD: 0+2]}, pendingCH=DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 2+0, Test-NodeC: 0+2, Test-NodeD: 0+2]}, unionCH=DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 0+2, Test-NodeC: 2+0, Test-NodeD: 0+2]}, actualMembers=[Test-NodeA, Test-NodeC, Test-NodeD], persistentUUIDs=[a6d4a46a-b6c4-45eb-b989-67edd9c1f626, 34f57148-f068-4ee0-ba19-332b28d08090, 54f45d82-1b1a-4686-a9e3-0b7e7d34b792]}
            13:33:30,345 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false
            13:33:30,345 TRACE (jgroups-5,Test-NodeA:[]) [JGroupsTransport] Test-NodeA received request 13 from Test-NodeC: StateResponseCommand{cache=defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=1, isLastChunk=true}], origin=Test-NodeC, topologyId=19, applyState=true}
            13:33:30,347 TRACE (remote-thread-Test-NodeA-p9678-t1:[defaultcache]) [CommitManager] Not committing key=MagicKey#k1{1BF/30F4FD51/0@Test-NodeB}. It is a state transfer key but no track is enabled!
            13:33:30,347 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true
            13:33:30,347 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 18, startRebalance = true, pending CH = DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 2+0, Test-NodeC: 0+2, Test-NodeD: 0+2]}
            

            Dan Berindei (Inactive) added a comment - The test still fails, but the failure is different now, because it's caused by ISPN-8240 : 13:33:30,325 TRACE (non-blocking-thread-Test-NodeA-p9677-t3:[]) [StateConsumerImpl] Received new topology for cache defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=18, phase=READ_OLD_WRITE_ALL, rebalanceId=6, currentCH=DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 0+0, Test-NodeB: 1+1, Test-NodeC: 1+1, Test-NodeD: 0+2]}, pendingCH=DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 2+0, Test-NodeB: 0+2, Test-NodeC: 0+2, Test-NodeD: 0+0]}, unionCH=DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 0+2, Test-NodeB: 1+1, Test-NodeC: 1+1, Test-NodeD: 0+2]}, actualMembers=[Test-NodeA, Test-NodeB, Test-NodeC, Test-NodeD], persistentUUIDs=[a6d4a46a-b6c4-45eb-b989-67edd9c1f626, 226427e7-140e-4fba-b4f4-71fd3ea29e59, 34f57148-f068-4ee0-ba19-332b28d08090, 54f45d82-1b1a-4686-a9e3-0b7e7d34b792]} 13:33:30,325 TRACE (non-blocking-thread-Test-NodeA-p9677-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 13:33:30,325 TRACE (non-blocking-thread-Test-NodeA-p9677-t3:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 13:33:30,329 TRACE (jgroups-5,Test-NodeA:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 18, startRebalance = true, pending CH = DefaultConsistentHash{ns=2, owners = (4)[Test-NodeA: 2+0, Test-NodeB: 0+2, Test-NodeC: 0+2, Test-NodeD: 0+0]} 13:33:30,330 TRACE (jgroups-5,Test-NodeA:[]) [JGroupsTransport] Test-NodeA received request 12 from Test-NodeC: StateResponseCommand{cache=defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=1, cacheEntries=1, isLastChunk=true}], origin=Test-NodeC, topologyId=18, applyState=true} 13:33:30,344 TRACE (remote-thread-Test-NodeA-p9678-t2:[defaultcache]) [CommitManager] Committed key=MagicKey#k2{1C0/33BD43A5/1@Test-NodeC}. Old discard policy=null. New discard policy=null 13:33:30,345 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [StateConsumerImpl] Received new topology for cache defaultcache, isRebalance = true, isMember = true, topology = CacheTopology{id=20, phase=READ_OLD_WRITE_ALL, rebalanceId=7, currentCH=DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 0+0, Test-NodeC: 2+0, Test-NodeD: 0+2]}, pendingCH=DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 2+0, Test-NodeC: 0+2, Test-NodeD: 0+2]}, unionCH=DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 0+2, Test-NodeC: 2+0, Test-NodeD: 0+2]}, actualMembers=[Test-NodeA, Test-NodeC, Test-NodeD], persistentUUIDs=[a6d4a46a-b6c4-45eb-b989-67edd9c1f626, 34f57148-f068-4ee0-ba19-332b28d08090, 54f45d82-1b1a-4686-a9e3-0b7e7d34b792]} 13:33:30,345 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = false 13:33:30,345 TRACE (jgroups-5,Test-NodeA:[]) [JGroupsTransport] Test-NodeA received request 13 from Test-NodeC: StateResponseCommand{cache=defaultcache, pushTransfer=false, stateChunks=[StateChunk{segmentId=0, cacheEntries=1, isLastChunk=true}], origin=Test-NodeC, topologyId=19, applyState=true} 13:33:30,347 TRACE (remote-thread-Test-NodeA-p9678-t1:[defaultcache]) [CommitManager] Not committing key=MagicKey#k1{1BF/30F4FD51/0@Test-NodeB}. It is a state transfer key but no track is enabled! 13:33:30,347 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [CommitManager] Set track to PUT_FOR_STATE_TRANSFER = true 13:33:30,347 TRACE (non-blocking-thread-Test-NodeA-p9677-t6:[]) [StateConsumerImpl] Topology update processed, stateTransferTopologyId = 18, startRebalance = true, pending CH = DefaultConsistentHash{ns=2, owners = (3)[Test-NodeA: 2+0, Test-NodeC: 0+2, Test-NodeD: 0+2]}

              Unassigned Unassigned
              rh-ee-galder Galder Zamarreño
              Archiver:
              rhn-support-adongare Amol Dongare

                Created:
                Updated:
                Resolved:
                Archived: