Uploaded image for project: 'JBoss Web Server'
  1. JBoss Web Server
  2. JWS-1397

jboss-webserver*-jdk8-openshift-rhel* sometimes hangs at startup [Jolokia]

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Blocker
    • 5.0.3 GA
    • 3.1.7.GA, JWS 5.0.0 GA, 5.1.0.GA
    • openshift
    • None

    Description

      jboss-webserver51-jdk8-openshift-rhel8:1.0 sometimes hangs at startup.

      logs:

      -XX:+UseParallelOldGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:MaxMetaspaceSize=100m -XX:+ExitOnOutOfMemoryError
      INFO Access log is disabled, ignoring configuration.
      -XX:+UseParallelOldGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:MaxMetaspaceSize=100m -XX:+ExitOnOutOfMemoryError
      -XX:+UseParallelOldGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:MaxMetaspaceSize=100m -XX:+ExitOnOutOfMemoryError
      INFO Running jboss-webserver-5/webserver51-tomcat9-jdk8-openshift image, version 1.0
      

      jstack output:

      2019-05-17 07:00:37
      Full thread dump OpenJDK 64-Bit Server VM (25.201-b09 mixed mode):
      
      "Attach Listener" #14 daemon prio=9 os_prio=0 tid=0x00007f8f6c001000 nid=0x178 waiting on condition [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
      
      "server-timer" #13 daemon prio=5 os_prio=0 tid=0x00007f8f600b0800 nid=0x13b in Object.wait() [0x00007f8f7cca7000]
         java.lang.Thread.State: TIMED_WAITING (on object monitor)
      	at java.lang.Object.wait(Native Method)
      	- waiting on <0x00000007a7b9dea8> (a java.util.TaskQueue)
      	at java.util.TimerThread.mainLoop(Timer.java:552)
      	- locked <0x00000007a7b9dea8> (a java.util.TaskQueue)
      	at java.util.TimerThread.run(Timer.java:505)
      
      "FileHandlerLogFilesCleaner-1" #12 daemon prio=5 os_prio=0 tid=0x00007f8f982ac000 nid=0x13a waiting for monitor entry [0x00007f8f7d0fa000]
         java.lang.Thread.State: BLOCKED (on object monitor)
      	at java.lang.Runtime.loadLibrary0(Runtime.java:862)
      	- waiting to lock <0x00000007a781aa68> (a java.lang.Runtime)
      	at java.lang.System.loadLibrary(System.java:1122)
      	at sun.nio.fs.UnixNativeDispatcher$1.run(UnixNativeDispatcher.java:573)
      	at sun.nio.fs.UnixNativeDispatcher$1.run(UnixNativeDispatcher.java:571)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at sun.nio.fs.UnixNativeDispatcher.<clinit>(UnixNativeDispatcher.java:571)
      	at sun.nio.fs.UnixFileSystem.<init>(UnixFileSystem.java:67)
      	at sun.nio.fs.LinuxFileSystem.<init>(LinuxFileSystem.java:39)
      	at sun.nio.fs.LinuxFileSystemProvider.newFileSystem(LinuxFileSystemProvider.java:46)
      	at sun.nio.fs.LinuxFileSystemProvider.newFileSystem(LinuxFileSystemProvider.java:39)
      	at sun.nio.fs.UnixFileSystemProvider.<init>(UnixFileSystemProvider.java:56)
      	at sun.nio.fs.LinuxFileSystemProvider.<init>(LinuxFileSystemProvider.java:41)
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
      	at java.lang.Class.newInstance(Class.java:442)
      	at sun.nio.fs.DefaultFileSystemProvider.createProvider(DefaultFileSystemProvider.java:48)
      	at sun.nio.fs.DefaultFileSystemProvider.create(DefaultFileSystemProvider.java:63)
      	at java.nio.file.FileSystems$DefaultFileSystemHolder.getDefaultProvider(FileSystems.java:108)
      	at java.nio.file.FileSystems$DefaultFileSystemHolder.access$000(FileSystems.java:89)
      	at java.nio.file.FileSystems$DefaultFileSystemHolder$1.run(FileSystems.java:98)
      	at java.nio.file.FileSystems$DefaultFileSystemHolder$1.run(FileSystems.java:96)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at java.nio.file.FileSystems$DefaultFileSystemHolder.defaultFileSystem(FileSystems.java:96)
      	at java.nio.file.FileSystems$DefaultFileSystemHolder.<clinit>(FileSystems.java:90)
      	at java.nio.file.FileSystems.getDefault(FileSystems.java:176)
      	at java.io.File.toPath(File.java:2234)
      	- locked <0x00000007a82d7f70> (a java.io.File)
      	at org.apache.juli.FileHandler.streamFilesForDelete(FileHandler.java:541)
      	at org.apache.juli.FileHandler.lambda$clean$0(FileHandler.java:528)
      	at org.apache.juli.FileHandler$$Lambda$1/596512129.run(Unknown Source)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      
      "AsyncFileHandlerWriter-1746572565" #11 daemon prio=5 os_prio=0 tid=0x00007f8f9825c000 nid=0x139 waiting on condition [0x00007f8f7d1fe000]
         java.lang.Thread.State: TIMED_WAITING (parking)
      	at sun.misc.Unsafe.park(Native Method)
      	- parking to wait for  <0x00000007a7d3dff0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
      	at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
      	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
      	at java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:522)
      	at java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:684)
      	at org.apache.juli.AsyncFileHandler$LoggerThread.run(AsyncFileHandler.java:160)
      
      "Service Thread" #8 daemon prio=9 os_prio=0 tid=0x00007f8f9822c000 nid=0x137 runnable [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
      
      "C1 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007f8f9821f000 nid=0x136 waiting on condition [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
      
      "C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007f8f9821e000 nid=0x135 waiting on condition [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
      
      "JolokiaStart" #5 daemon prio=5 os_prio=0 tid=0x00007f8f98210000 nid=0x134 in Object.wait() [0x00007f8f7d600000]
         java.lang.Thread.State: RUNNABLE
      	at java.nio.file.FileSystems.getDefault(FileSystems.java:176)
      	at java.nio.file.Paths.get(Paths.java:138)
      	at sun.misc.Launcher$ExtClassLoader.findLibrary(Launcher.java:235)
      	at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1830)
      	at java.lang.Runtime.loadLibrary0(Runtime.java:870)
      	- locked <0x00000007a781aa68> (a java.lang.Runtime)
      	at java.lang.System.loadLibrary(System.java:1122)
      	at sun.security.ec.SunEC$1.run(SunEC.java:60)
      	at sun.security.ec.SunEC$1.run(SunEC.java:58)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at sun.security.ec.SunEC.<clinit>(SunEC.java:58)
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
      	at java.lang.Class.newInstance(Class.java:442)
      	at sun.security.jca.ProviderConfig$2.run(ProviderConfig.java:221)
      	at sun.security.jca.ProviderConfig$2.run(ProviderConfig.java:206)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at sun.security.jca.ProviderConfig.doLoadProvider(ProviderConfig.java:206)
      	at sun.security.jca.ProviderConfig.getProvider(ProviderConfig.java:187)
      	- locked <0x00000007a7bc90a8> (a sun.security.jca.ProviderConfig)
      	at sun.security.jca.ProviderList.getProvider(ProviderList.java:233)
      	at sun.security.jca.ProviderList.getService(ProviderList.java:331)
      	at sun.security.jca.GetInstance.getInstance(GetInstance.java:157)
      	at javax.net.ssl.SSLContext.getInstance(SSLContext.java:156)
      	at org.jolokia.jvmagent.JolokiaServer.createHttpsServer(JolokiaServer.java:263)
      	at org.jolokia.jvmagent.JolokiaServer.createHttpServer(JolokiaServer.java:240)
      	at org.jolokia.jvmagent.JolokiaServer.init(JolokiaServer.java:170)
      	at org.jolokia.jvmagent.JolokiaServer.<init>(JolokiaServer.java:80)
      	at org.jolokia.jvmagent.JvmAgent$1.run(JvmAgent.java:98)
      
      "Signal Dispatcher" #4 daemon prio=9 os_prio=0 tid=0x00007f8f9816f800 nid=0x133 runnable [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
      
      "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f8f98147000 nid=0x132 in Object.wait() [0x00007f8f7dc27000]
         java.lang.Thread.State: WAITING (on object monitor)
      	at java.lang.Object.wait(Native Method)
      	- waiting on <0x00000007a7808ed0> (a java.lang.ref.ReferenceQueue$Lock)
      	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
      	- locked <0x00000007a7808ed0> (a java.lang.ref.ReferenceQueue$Lock)
      	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
      	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)
      
      "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f8f98142800 nid=0x131 in Object.wait() [0x00007f8f7dd28000]
         java.lang.Thread.State: WAITING (on object monitor)
      	at java.lang.Object.wait(Native Method)
      	- waiting on <0x00000007a7806bf8> (a java.lang.ref.Reference$Lock)
      	at java.lang.Object.wait(Object.java:502)
      	at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
      	- locked <0x00000007a7806bf8> (a java.lang.ref.Reference$Lock)
      	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
      
      "main" #1 prio=5 os_prio=0 tid=0x00007f8f9804e800 nid=0x12e waiting for monitor entry [0x00007f8f9e821000]
         java.lang.Thread.State: BLOCKED (on object monitor)
      	at java.lang.Runtime.load0(Runtime.java:801)
      	- waiting to lock <0x00000007a781aa68> (a java.lang.Runtime)
      	at java.lang.System.load(System.java:1086)
      	at org.apache.tomcat.jni.Library.<init>(Library.java:42)
      	at org.apache.tomcat.jni.Library.initialize(Library.java:206)
      	- locked <0x00000007a916ab78> (a java.lang.Class for org.apache.tomcat.jni.Library)
      	at org.apache.catalina.core.AprLifecycleListener.init(AprLifecycleListener.java:198)
      	at org.apache.catalina.core.AprLifecycleListener.isAprAvailable(AprLifecycleListener.java:107)
      	- locked <0x00000007a8977d38> (a java.lang.Object)
      	at org.apache.catalina.connector.Connector.<init>(Connector.java:79)
      	at org.apache.catalina.startup.ConnectorCreateRule.begin(ConnectorCreateRule.java:64)
      	at org.apache.tomcat.util.digester.Digester.startElement(Digester.java:1188)
      	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:509)
      	at com.sun.org.apache.xerces.internal.parsers.AbstractXMLDocumentParser.emptyElement(AbstractXMLDocumentParser.java:182)
      	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanStartElement(XMLDocumentFragmentScannerImpl.java:1339)
      	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2784)
      	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602)
      	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505)
      	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:842)
      	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:771)
      	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
      	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213)
      	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643)
      	at org.apache.tomcat.util.digester.Digester.parse(Digester.java:1453)
      	at org.apache.catalina.startup.Catalina.load(Catalina.java:605)
      	at org.apache.catalina.startup.Catalina.load(Catalina.java:656)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.apache.catalina.startup.Bootstrap.load(Bootstrap.java:306)
      	at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:491)
      
      "VM Thread" os_prio=0 tid=0x00007f8f98138800 nid=0x130 runnable 
      
      "GC task thread#0 (ParallelGC)" os_prio=0 tid=0x00007f8f98061000 nid=0x12f runnable 
      
      "VM Periodic Task Thread" os_prio=0 tid=0x00007f8f9822e800 nid=0x138 waiting on condition 
      
      JNI global references: 333
      

      Maybe related to

      https://bz.apache.org/bugzilla/show_bug.cgi?id=63251
      https://bugs.openjdk.java.net/browse/JDK-8194653

      Attachments

        Issue Links

          Activity

            People

              rmaucher Remy Maucherat
              maschmid@redhat.com Marek Schmidt
              Marek Schmidt Marek Schmidt
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: