Uploaded image for project: 'mod_cluster'
  1. mod_cluster
  2. MODCLUSTER-782

Problems when undeploying under stress

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Can't Do
    • Icon: Major Major
    • 2.0.3.Final
    • 1.4.3.Final
    • None
    • None
    • Hide

      Run SmoothFailoverTest.undeployTest in any clone of our jenkins.

      Ask for more information if needed.

      Show
      Run SmoothFailoverTest.undeployTest in any clone of our jenkins. Ask for more information if needed.

      Our test "undeployTest" (source code) has been failing occassionally, but it used to be ~10% of the times and now it is more like 50% of the times.

      It fails to stop at least one of the wIt fails to stop at least one of the worker with the following error:orker with the following error:

      04-Apr-2023 06:12:39.764 INFO [Catalina-utility-2] org.apache.catalina.startup.HostConfig.undeploy Undeploying context [/clusterbench]
      04-Apr-2023 06:12:45.433 INFO [main] org.apache.catalina.core.StandardServer.await A valid shutdown command was received via the shutdown port. Stopping the Server instance.
      04-Apr-2023 06:12:45.436 INFO [main] org.jboss.modcluster.ModClusterService.drainRequests MODCLUSTER000021: All pending requests drained from localhost: in 0.0 seconds
      04-Apr-2023 06:12:45.439 INFO [main] org.jboss.modcluster.ModClusterService.drainRequests MODCLUSTER000021: All pending requests drained from localhost:/examples in 0.0 seconds
      04-Apr-2023 06:12:45.442 INFO [main] org.jboss.modcluster.ModClusterService.drainRequests MODCLUSTER000021: All pending requests drained from localhost:/host-manager in 0.0 seconds
      04-Apr-2023 06:12:45.444 INFO [main] org.jboss.modcluster.ModClusterService.drainRequests MODCLUSTER000021: All pending requests drained from localhost:/manager in 0.0 seconds
      04-Apr-2023 06:12:45.450 INFO [main] org.jboss.modcluster.ModClusterService.drainRequests MODCLUSTER000021: All pending requests drained from localhost:/docs in 0.0 seconds
      04-Apr-2023 06:12:45.452 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8080"]
      04-Apr-2023 06:12:45.453 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["ajp-nio-10.0.139.134-8009"]
      04-Apr-2023 06:12:45.455 INFO [main] org.apache.catalina.core.StandardService.stopInternal Stopping service [Catalina]
      04-Apr-2023 06:12:45.499 SEVERE [main] org.apache.catalina.core.ContainerBase.stopInternal A child container failed during stop
      	java.util.concurrent.ExecutionException: org.apache.catalina.LifecycleException: An invalid Lifecycle transition was attempted ([before_stop]) for component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/clusterbench]] in state [DESTROYED]
      		at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
      		at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
      		at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:992)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1412)
      		at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1401)
      		at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      		at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
      		at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:145)
      		at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:986)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.StandardService.stopInternal(StandardService.java:497)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.StandardServer.stopInternal(StandardServer.java:979)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.startup.Catalina.stop(Catalina.java:849)
      		at org.apache.catalina.startup.Catalina.start(Catalina.java:811)
      		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
      		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      		at java.base/java.lang.reflect.Method.invoke(Method.java:568)
      		at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
      		at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
      	Caused by: org.apache.catalina.LifecycleException: An invalid Lifecycle transition was attempted ([before_stop]) for component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/clusterbench]] in state [DESTROYED]
      		at org.apache.catalina.util.LifecycleBase.invalidTransition(LifecycleBase.java:430)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:244)
      		at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1412)
      		at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1401)
      		at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      		at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
      		at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:145)
      		at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:986)
      		... 20 more
      04-Apr-2023 06:12:45.500 SEVERE [main] org.apache.catalina.core.ContainerBase.stopInternal A child container failed during stop
      	java.util.concurrent.ExecutionException: org.apache.catalina.LifecycleException: A child container failed during stop
      		at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
      		at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
      		at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:992)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.StandardService.stopInternal(StandardService.java:497)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.StandardServer.stopInternal(StandardServer.java:979)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.startup.Catalina.stop(Catalina.java:849)
      		at org.apache.catalina.startup.Catalina.start(Catalina.java:811)
      		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
      		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      		at java.base/java.lang.reflect.Method.invoke(Method.java:568)
      		at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
      		at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
      	Caused by: org.apache.catalina.LifecycleException: A child container failed during stop
      		at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:1000)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1412)
      		at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1401)
      		at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
      		at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
      		at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:145)
      		at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:986)
      		... 13 more
      04-Apr-2023 06:12:45.500 SEVERE [main] org.apache.catalina.startup.Catalina.stop Error stopping Catalina
      	org.apache.catalina.LifecycleException: A child container failed during stop
      		at org.apache.catalina.core.ContainerBase.stopInternal(ContainerBase.java:1000)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.StandardService.stopInternal(StandardService.java:497)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.core.StandardServer.stopInternal(StandardServer.java:979)
      		at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:257)
      		at org.apache.catalina.startup.Catalina.stop(Catalina.java:849)
      		at org.apache.catalina.startup.Catalina.start(Catalina.java:811)
      		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      		at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
      		at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      		at java.base/java.lang.reflect.Method.invoke(Method.java:568)
      		at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
      		at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:476)
      

            rhn-engineering-rhusar Radoslav Husar
            sgala@redhat.com Santiago Gala
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: