-
Bug
-
Resolution: Done
-
Blocker
-
7.1.0.DR18, 7.1.0.DR19, 7.1.0.ER1, 7.1.0.ER2
-
Blocks Testing
-
-
-
-
-
-
-
Scenario: There are two Artemis servers configured as replicated Live-Backup pair. During the initial synchronization both servers are stopped.
Expectation: Both servers are successfully stopped.
Reality: Stopping phase of the backup hangs because of deadlock [1].
Customer impact: There is a risk that two Java threads may get into the deadlock. Such server will hang and it will be unable to stop.
In an attachment you can find the entire thread dump.
[1]
Found one Java-level deadlock: ============================= "Thread-0 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector-3817308)": waiting to lock monitor 0x00877690 (object 0x404a3ea8, a org.apache.activemq.artemis.core.replication.ReplicationEndpoint), which is held by "AMQ119000: Activation for server ActiveMQServerImpl::ReplicatedLargeMessageWithDelayFailoverTest/backupServers" "AMQ119000: Activation for server ActiveMQServerImpl::ReplicatedLargeMessageWithDelayFailoverTest/backupServers": waiting for ownable synchronizer 0x404ca8b0, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync), which is held by "Thread-0 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector-3817308)" Java stack information for the threads listed above: =================================================== "Thread-0 (org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnector-3817308)": at org.apache.activemq.artemis.core.replication.ReplicationEndpoint.registerJournal(ReplicationEndpoint.java:143) - waiting to lock <0x404a3ea8> (a org.apache.activemq.artemis.core.replication.ReplicationEndpoint) at org.apache.activemq.artemis.core.replication.ReplicationEndpoint.finishSynchronization(ReplicationEndpoint.java:342) at org.apache.activemq.artemis.core.replication.ReplicationEndpoint.handleStartReplicationSynchronization(ReplicationEndpoint.java:435) at org.apache.activemq.artemis.core.replication.ReplicationEndpoint.handlePacket(ReplicationEndpoint.java:195) at org.apache.activemq.artemis.tests.integration.cluster.util.BackupSyncDelay$ReplicationChannelHandler.handlePacket(BackupSyncDelay.java:183) - locked <0x404a3f18> (a org.apache.activemq.artemis.tests.integration.cluster.util.BackupSyncDelay$ReplicationChannelHandler) at org.apache.activemq.artemis.core.protocol.core.impl.ChannelImpl.handlePacket(ChannelImpl.java:623) at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.doBufferReceived(RemotingConnectionImpl.java:379) - locked <0x404a3f38> (a java.lang.Object) at org.apache.activemq.artemis.core.protocol.core.impl.RemotingConnectionImpl.bufferReceived(RemotingConnectionImpl.java:362) at org.apache.activemq.artemis.core.client.impl.ClientSessionFactoryImpl$DelegatingBufferHandler.bufferReceived(ClientSessionFactoryImpl.java:1143) at org.apache.activemq.artemis.core.remoting.impl.invm.InVMConnection$1.run(InVMConnection.java:196) at org.apache.activemq.artemis.utils.OrderedExecutorFactory$OrderedExecutor$ExecutorTask.run(OrderedExecutorFactory.java:101) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) "AMQ119000: Activation for server ActiveMQServerImpl::ReplicatedLargeMessageWithDelayFailoverTest/backupServers": at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x404ca8b0> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199) at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943) at org.apache.activemq.artemis.core.journal.impl.JournalImpl.stop(JournalImpl.java:2332) - locked <0x404ca060> (a org.apache.activemq.artemis.core.journal.impl.JournalImpl) at org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager.stop(JournalStorageManager.java:244) - locked <0x404c9c90> (a org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager) at org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager.stop(JournalStorageManager.java:181) at org.apache.activemq.artemis.core.replication.ReplicationEndpoint.stop(ReplicationEndpoint.java:319) - locked <0x404a3ea8> (a org.apache.activemq.artemis.core.replication.ReplicationEndpoint) at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.stopComponent(ActiveMQServerImpl.java:1110) at org.apache.activemq.artemis.core.server.impl.SharedNothingBackupActivation.run(SharedNothingBackupActivation.java:252) at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$ActivationThread.run(ActiveMQServerImpl.java:2491) Found 1 deadlock.
- is blocked by
-
JBEAP-12044 Upgrade Artemis 1.5.5.jbossorg-006
-
- Verified
-
- is incorporated by
-
-
- Verified
-
