Uploaded image for project: 'Red Hat Fuse'
  1. Red Hat Fuse
  2. ENTESB-2954

Sometimes InstanceAlreadyExistsException: org.apache.activemq:type=Broker,brokerName=broker-nossl and container hangs in status Waiting, when restarting mq-replicated ssh container

XMLWordPrintable

    • % %
    • Hide
      1. start ssh server
      2. Start Fuse and create fabric, and wait for provision.
      3. Run commands:
        mq-create --no-ssl --parent-profile=mq-replicated --group a broker-nossl-b
        
        profile-edit --system org.apache.activemq.leveldb.test=true mq-broker-a.broker-nossl-b
        
        fabric:container-create-ssh --user USER --host 127.0.0.1  --profile mq-broker-a.broker-nossl-b --password PASSWORD -new-user admin --new-user-password admin  broker-nossl-c0
        
        fabric:container-create-ssh --user USER --host 127.0.0.1  --profile mq-broker-a.broker-nossl-b --password PASSWORD -new-user admin --new-user-password admin  broker-nossl-c1
        
        fabric:container-create-ssh --user USER --host 127.0.0.1  --profile mq-broker-a.broker-nossl-b --password PASSWORD -new-user admin --new-user-password admin  broker-nossl-c2
        
      4. wait for all containers to start successfully
      5. kill master container
        kill -9 processID
        

        and wait for empty processId using 'container-info NAME'

      6. Start killed container with
        container-start NAME
        
      Show
      start ssh server Start Fuse and create fabric, and wait for provision. Run commands: mq-create --no-ssl --parent-profile=mq-replicated --group a broker-nossl-b profile-edit --system org.apache.activemq.leveldb.test= true mq-broker-a.broker-nossl-b fabric:container-create-ssh --user USER --host 127.0.0.1 --profile mq-broker-a.broker-nossl-b --password PASSWORD - new -user admin -- new -user-password admin broker-nossl-c0 fabric:container-create-ssh --user USER --host 127.0.0.1 --profile mq-broker-a.broker-nossl-b --password PASSWORD - new -user admin -- new -user-password admin broker-nossl-c1 fabric:container-create-ssh --user USER --host 127.0.0.1 --profile mq-broker-a.broker-nossl-b --password PASSWORD - new -user admin -- new -user-password admin broker-nossl-c2 wait for all containers to start successfully kill master container kill -9 processID and wait for empty processId using 'container-info NAME' Start killed container with container-start NAME

      When restarting ssh replicated levelDB container an error InstanceAlreadyExistsException is continuosly logged, and container stays in Waiting status for 13 minutes:

      2015-03-30 00:29:30,392 | ERROR | pool-38-thread-1 | BrokerService                    | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Failed to start Apache ActiveMQ ([broker-nossl, null], javax.management.InstanceAlreadyExistsException: org.apache.activemq:type=Broker,brokerName=broker-nossl)
      2015-03-30 00:29:30,392 | INFO  | pool-39-thread-1 | ActiveMQServiceFactory           | 174 - io.fabric8.mq.mq-fabric - 1.2.0.redhat-101 | Broker broker-nossl failed to start.  Will try again in 10 seconds
      2015-03-30 00:29:30,392 | ERROR | pool-39-thread-1 | ActiveMQServiceFactory           | 174 - io.fabric8.mq.mq-fabric - 1.2.0.redhat-101 | Exception on start: org.apache.activemq:type=Broker,brokerName=broker-nossl
      javax.management.InstanceAlreadyExistsException: org.apache.activemq:type=Broker,brokerName=broker-nossl
      	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)[:1.7.0_45]
      	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)[:1.7.0_45]
      	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)[:1.7.0_45]
      	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)[:1.7.0_45]
      	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)[:1.7.0_45]
      	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)[:1.7.0_45]
      	at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)[:1.7.0_45]
      	at java.lang.reflect.Method.invoke(Method.java:606)[:1.7.0_45]
      	at org.apache.karaf.management.boot.KarafMBeanServerBuilder$MBeanInvocationHandler.invoke(KarafMBeanServerBuilder.java:80)[karaf-jmx-boot.jar:]
      	at com.sun.proxy.$Proxy0.registerMBean(Unknown Source)[:]
      	at org.apache.activemq.broker.jmx.ManagementContext.registerMBean(ManagementContext.java:392)[180:org.apache.activemq.activemq-osgi:5.11.0.redhat-620102]
      	at org.apache.activemq.broker.jmx.AnnotatedMBean.registerMBean(AnnotatedMBean.java:72)[180:org.apache.activemq.activemq-osgi:5.11.0.redhat-620102]
      	at org.apache.activemq.broker.BrokerService.startManagementContext(BrokerService.java:2494)[180:org.apache.activemq.activemq-osgi:5.11.0.redhat-620102]
      	at org.apache.activemq.broker.BrokerService.start(BrokerService.java:592)[180:org.apache.activemq.activemq-osgi:5.11.0.redhat-620102]
      	at io.fabric8.mq.fabric.ActiveMQServiceFactory$ClusteredConfiguration.doStart(ActiveMQServiceFactory.java:500)[174:io.fabric8.mq.mq-fabric:1.2.0.redhat-101]
      	at io.fabric8.mq.fabric.ActiveMQServiceFactory$ClusteredConfiguration.access$400(ActiveMQServiceFactory.java:312)[174:io.fabric8.mq.mq-fabric:1.2.0.redhat-101]
      	at io.fabric8.mq.fabric.ActiveMQServiceFactory$ClusteredConfiguration$1.run(ActiveMQServiceFactory.java:443)[174:io.fabric8.mq.mq-fabric:1.2.0.redhat-101]
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)[:1.7.0_45]
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262)[:1.7.0_45]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)[:1.7.0_45]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)[:1.7.0_45]
      	at java.lang.Thread.run(Thread.java:744)[:1.7.0_45]
      2015-03-30 00:29:30,392 | INFO  | pool-38-thread-1 | BrokerService                    | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Apache ActiveMQ 5.11.0.redhat-620102 (broker-nossl, null) is shutting down
      2015-03-30 00:29:30,394 | INFO  | pool-38-thread-1 | TransportConnector               | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Connector openwire stopped
      2015-03-30 00:29:30,394 | INFO  | pool-38-thread-1 | TransportConnector               | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Connector mqtt stopped
      2015-03-30 00:29:30,394 | INFO  | pool-38-thread-1 | TransportConnector               | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Connector amqp stopped
      2015-03-30 00:29:30,394 | INFO  | pool-38-thread-1 | TransportConnector               | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Connector stomp stopped
      2015-03-30 00:29:30,394 | INFO  | pool-38-thread-1 | TransportConnector               | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Connector ws stopped
      2015-03-30 00:29:30,395 | INFO  | pool-38-thread-1 | BrokerService                    | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Apache ActiveMQ 5.11.0.redhat-620102 (broker-nossl, null) uptime 0.005 seconds
      2015-03-30 00:29:30,395 | INFO  | pool-38-thread-1 | BrokerService                    | 180 - org.apache.activemq.activemq-osgi - 5.11.0.redhat-620102 | Apache ActiveMQ 5.11.0.redhat-620102 (broker-nossl, null) is shutdown
      2015-03-30 00:29:30,395 | INFO  | pool-38-thread-1 | ActiveMQServiceFactory           | 174 - io.fabric8.mq.mq-fabric - 1.2.0.redhat-101 | Broker broker-nossl failed to start.  Will try again in 10 seconds
      

        1. fuse.log
          966 kB
        2. fuse-broker-nossl-c0.log
          1.92 MB

            hchirino Hiram Chirino
            emedvede Elena Medvedeva (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: