Uploaded image for project: 'WildFly'
  1. WildFly
  2. WFLY-13444

Observing High CPU in EPollArrayWrapper.epollCtl default I/O thread

    Details

    • Type: Bug
    • Status: Resolved (View Workflow)
    • Priority: Critical
    • Resolution: Out of Date
    • Affects Version/s: 10.1.0.Final
    • Fix Version/s: None
    • Component/s: Remoting
    • Labels:
      None

      Description

      Facing high CPU by one of the default I/O thread In Wildfly 10.1.0 Final. Looks none of our application component thread is consuming.

      Can somebody check what is triggering this issue? I attached the thread stack to this Jira. This is blocking our releases. When the CPU cores are high in number, multiple default I/O threads will kick in consuming the CPU in 90~100% range continuously.

      Wildfly 10.1.0 Final
      Java -
      openjdk version "1.8.0_232"
      OpenJDK Runtime Environment (build 1.8.0_232-b09)
      OpenJDK 64-Bit Server VM (build 25.232-b09, mixed mode

      ---------------------------------------------------------------------------------------------------

      at java.lang.Throwable.fillInStackTrace(Native Method)
      at java.lang.Throwable.fillInStackTrace(Throwable.java:784)
      at java.lang.Throwable.<init>(Throwable.java:251)
      at java.lang.Exception.<init>(Exception.java:54)
      at java.io.IOException.<init>(IOException.java:47)
      at java.nio.channels.ClosedChannelException.<init>(ClosedChannelException.java:52)
      at org.xnio.ssl.JsseStreamConduit.write(JsseStreamConduit.java:1022)
      at org.xnio.conduits.ConduitStreamSinkChannel.write(ConduitStreamSinkChannel.java:150)
      at org.xnio.http.HttpUpgrade$HttpUpgradeState$StringWriteListener.handleEvent(HttpUpgrade.java:385)
      at org.xnio.http.HttpUpgrade$HttpUpgradeState$StringWriteListener.handleEvent(HttpUpgrade.java:372)
      at org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92)
      at org.xnio.conduits.WriteReadyHandler$ChannelListenerHandler.writeReady(WriteReadyHandler.java:65)
      at org.xnio.ssl.JsseStreamConduit.run(JsseStreamConduit.java:393)
      at org.xnio.ssl.JsseStreamConduit.readReady(JsseStreamConduit.java:547)
      at org.xnio.ssl.JsseStreamConduit$2.readReady(JsseStreamConduit.java:319)
      at org.xnio.nio.NioSocketConduit.handleReady(NioSocketConduit.java:89)
      at org.xnio.nio.WorkerThread.run(WorkerThread.java:567)

      -------------------------------------------------------------------------------------------
      at sun.nio.ch.EPollArrayWrapper.epollCtl(Native Method)
      at sun.nio.ch.EPollArrayWrapper.updateRegistrations(EPollArrayWrapper.java:299)
      at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:268)
      at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
      at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
      at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
      at org.xnio.nio.WorkerThread.run(WorkerThread.java:515)

      -----------------------------------------------------------------------------------

        Gliffy Diagrams

          Attachments

          1. default io consuming.PNG
            default io consuming.PNG
            71 kB
          2. default io consuming snapshot.PNG
            default io consuming snapshot.PNG
            81 kB
          3. default IO thread 73.PNG
            default IO thread 73.PNG
            589 kB
          4. IO thread.PNG
            IO thread.PNG
            54 kB
          5. IO thread memory.PNG
            IO thread memory.PNG
            249 kB
          6. stack trace from snapshot.PNG
            stack trace from snapshot.PNG
            108 kB
          7. stack trace in thread dump.PNG
            stack trace in thread dump.PNG
            50 kB
          8. Thread consuming high CPU.PNG
            Thread consuming high CPU.PNG
            48 kB
          9. threaddump-1589514505334.tdump
            622 kB
          10. ThreadDump1set.zip
            70 kB
          11. ThreadDump2set.zip
            58 kB
          12. top command output.PNG
            top command output.PNG
            883 kB

            Activity

              People

              • Assignee:
                flavia.rainone Flavia Rainone
                Reporter:
                ev.srinivas Srinivas ev
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: