Loading...

Type: Bug
Resolution: Obsolete
Priority: Major
Fix Version/s: None
Affects Version/s: None
Component/s: high-availability
Labels:
None

Steps to Reproduce:

Hide

1. Start one pair of Live-Backup brokers with NSF based shared-store configuration.
2. Update broker.xml e.g. increase max-disk-usage on running Live node.
3. As expected no errors:
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...security
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...address settings
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...diverts
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...addresses
INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying queue DLQ
INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying queue ExpiryQueue
4. Update broker.xml on running backup node
5. Expected: successful configuration update
Actual result:
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...security
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...address settings
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...diverts
INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...addresses
ERROR [org.apache.activemq.artemis.core.server] AMQ224008: Failed to store id: java.lang.IllegalStateException: Journal must be in state=LOADED, was [STARTED]

Show
1. Start one pair of Live-Backup brokers with NSF based shared-store configuration. 2. Update broker.xml e.g. increase max-disk-usage on running Live node. 3. As expected no errors: INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...security INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...address settings INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...diverts INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...addresses INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying queue DLQ INFO [org.apache.activemq.artemis.core.server] AMQ221003: Deploying queue ExpiryQueue 4. Update broker.xml on running backup node 5. Expected: successful configuration update Actual result: INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...security INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...address settings INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...diverts INFO [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...addresses ERROR [org.apache.activemq.artemis.core.server] AMQ224008: Failed to store id: java.lang.IllegalStateException: Journal must be in state=LOADED, was [STARTED]

SFDC Cases Counter:
SFDC Cases Links:

Broker unable to reload updated broker.xml on running backup node.

10:28:34,542 INFO  [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...security
10:28:34,542 INFO  [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...address settings
10:28:34,543 INFO  [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...diverts
10:28:34,543 INFO  [org.apache.activemq.artemis.core.server] AMQ221056: Reloading configuration ...addresses
10:28:34,563 ERROR [org.apache.activemq.artemis.core.server] AMQ224008: Failed to store id: java.lang.IllegalStateException: Journal must be in state=LOADED, was [STARTED]
        at org.apache.activemq.artemis.core.journal.impl.JournalImpl.checkJournalIsLoaded(JournalImpl.java:966) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.journal.impl.JournalImpl.appendAddRecord(JournalImpl.java:725) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.journal.impl.JournalBase.appendAddRecord(JournalBase.java:49) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.journal.impl.JournalImpl.appendAddRecord(JournalImpl.java:88) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.journal.Journal.appendAddRecord(Journal.java:65) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.persistence.impl.journal.AbstractJournalStorageManager.storeID(AbstractJournalStorageManager.java:769) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.persistence.impl.journal.BatchingIDGenerator.storeID(BatchingIDGenerator.java:147) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.persistence.impl.journal.BatchingIDGenerator.saveCheckPoint(BatchingIDGenerator.java:132) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.persistence.impl.journal.BatchingIDGenerator.generateID(BatchingIDGenerator.java:111) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.persistence.impl.journal.AbstractJournalStorageManager.generateID(AbstractJournalStorageManager.java:313) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.addAddressInfo(ActiveMQServerImpl.java:2461) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.addOrUpdateAddressInfo(ActiveMQServerImpl.java:2473) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.deployAddressesFromConfiguration(ActiveMQServerImpl.java:2324) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.access$500(ActiveMQServerImpl.java:180) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$ConfigurationFileReloader.reload(ActiveMQServerImpl.java:2817) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.reload.ReloadManagerImpl$ReloadRegistry.check(ReloadManagerImpl.java:124) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.reload.ReloadManagerImpl.tick(ReloadManagerImpl.java:67) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.reload.ReloadManagerImpl.run(ReloadManagerImpl.java:48) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent$2.run(ActiveMQScheduledComponent.java:189) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:42) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:31) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.utils.actors.ProcessorBase$ExecutorTask.run(ProcessorBase.java:53) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_121]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_121]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_121]

10:28:34,567 ERROR [org.apache.activemq.artemis.core.server] AMQ224069: Change detected in broker configuration file, but reload failed: java.lang.IllegalStateException: Journal must be in state=LOADED, was [STARTED]
        at org.apache.activemq.artemis.core.journal.impl.JournalImpl.checkJournalIsLoaded(JournalImpl.java:966) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.journal.impl.JournalImpl.appendAddRecordTransactional(JournalImpl.java:888) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.journal.Journal.appendAddRecordTransactional(Journal.java:117) [artemis-journal-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.persistence.impl.journal.AbstractJournalStorageManager.addAddressBinding(AbstractJournalStorageManager.java:1271) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.addAddressInfo(ActiveMQServerImpl.java:2462) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.addOrUpdateAddressInfo(ActiveMQServerImpl.java:2473) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.deployAddressesFromConfiguration(ActiveMQServerImpl.java:2324) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.access$500(ActiveMQServerImpl.java:180) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$ConfigurationFileReloader.reload(ActiveMQServerImpl.java:2817) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.reload.ReloadManagerImpl$ReloadRegistry.check(ReloadManagerImpl.java:124) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.reload.ReloadManagerImpl.tick(ReloadManagerImpl.java:67) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.reload.ReloadManagerImpl.run(ReloadManagerImpl.java:48) [artemis-server-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent$2.run(ActiveMQScheduledComponent.java:189) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:42) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:31) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at org.apache.activemq.artemis.utils.actors.ProcessorBase$ExecutorTask.run(ProcessorBase.java:53) [artemis-commons-2.0.0.amq-700011-redhat-1.jar:2.0.0.amq-700011-redhat-1]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_121]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [rt.jar:1.8.0_121]
        at java.lang.Thread.run(Thread.java:745) [rt.jar:1.8.0_121]

is related to

ENTMQBR-1170 The slave after the configuration reload cannot be a live server

Closed

Details

Description

Attachments

Issue Links

Activity

People

Dates