Uploaded image for project: 'JBoss Enterprise Application Platform'
  1. JBoss Enterprise Application Platform
  2. JBEAP-11859

"WFLYPRT0060: Channel open request timed out" exception on CLI class

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Do
    • Major
    • None
    • 7.1.0.ER1
    • CLI
    • None

    Description

      Description of problem:
      Client is unable to connect to remote+http://localhost:9990 intermittently

      Exception from client side is thrown after 10 seconds

      How reproducible:
      ~1/80000 times

      Steps to Reproduce:

      for (int i = 1; i <= requests; i++) {
            ModelControllerClientConfiguration config = new ModelControllerClientConfiguration.Builder()
                    .setProtocol("remote+http")
                    .setHostName("127.0.0.1")
                    .setPort(9990)
                    .setConnectionTimeout(30000)
                    .build();
            org.jboss.as.controller.client.ModelControllerClient c = org.jboss.as.controller.client.ModelControllerClient.Factory.create(config);
            DefaultOperationRequestBuilder builder = new DefaultOperationRequestBuilder();
            builder.setOperationName(org.jboss.as.cli.Util.READ_ATTRIBUTE);
            builder.addProperty(org.jboss.as.cli.Util.NAME, org.jboss.as.cli.Util.NAME);
            c.execute(builder.buildRequest());
            c.close();
}

      Actual results:
      Stack trace:

      12/07/2017 10:01:47.115 - [ManagementRepeatingWorker.executeCall] [WARNING] java.io.IOException: java.io.IOException: WFLYPRT0060: Channel open request timed out
	at org.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:149)
	at org.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:75)
	at org.jboss.qa.repetitive.cli.worker.ManagementRepeatingWorker.executeCall(ManagementRepeatingWorker.java:158)
	at org.jboss.qa.repetitive.cli.worker.ManagementRepeatingWorker.run(ManagementRepeatingWorker.java:97)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: WFLYPRT0060: Channel open request timed out
	at org.jboss.as.protocol.mgmt.FutureManagementChannel.openChannel(FutureManagementChannel.java:157)
	at org.jboss.as.protocol.mgmt.ManagementClientChannelStrategy$Establishing.openChannel(ManagementClientChannelStrategy.java:192)
	at org.jboss.as.protocol.mgmt.ManagementClientChannelStrategy$Establishing.connectionOpened(ManagementClientChannelStrategy.java:173)
	at org.jboss.as.protocol.ProtocolConnectionManager.connect(ProtocolConnectionManager.java:78)
	at org.jboss.as.protocol.mgmt.ManagementClientChannelStrategy$Establishing.getChannel(ManagementClientChannelStrategy.java:162)
	at org.jboss.as.controller.client.impl.RemotingModelControllerClient.getOrCreateChannel(RemotingModelControllerClient.java:146)
	at org.jboss.as.controller.client.impl.RemotingModelControllerClient$1.getChannel(RemotingModelControllerClient.java:60)
	at org.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:135)
	at org.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:110)
	at org.jboss.as.controller.client.impl.AbstractModelControllerClient.executeRequest(AbstractModelControllerClient.java:263)
	at org.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:168)
	at org.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:147)
	... 6 more

      Important thread from thread dump:

      Thread[pool-1-thread-1,5,main]
	sun.misc.Unsafe.park(Native Method)
	java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
	org.xnio.AbstractIoFuture.await(AbstractIoFuture.java:455)
	org.jboss.as.protocol.mgmt.FutureManagementChannel.openChannel(FutureManagementChannel.java:154)
	org.jboss.as.protocol.mgmt.ManagementClientChannelStrategy$Establishing.openChannel(ManagementClientChannelStrategy.java:192)
	org.jboss.as.protocol.mgmt.ManagementClientChannelStrategy$Establishing.connectionOpened(ManagementClientChannelStrategy.java:173)
	org.jboss.as.protocol.ProtocolConnectionManager.connect(ProtocolConnectionManager.java:78)
	org.jboss.as.protocol.mgmt.ManagementClientChannelStrategy$Establishing.getChannel(ManagementClientChannelStrategy.java:162)
	org.jboss.as.controller.client.impl.RemotingModelControllerClient.getOrCreateChannel(RemotingModelControllerClient.java:146)
	org.jboss.as.controller.client.impl.RemotingModelControllerClient$1.getChannel(RemotingModelControllerClient.java:60)
	org.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:135)
	org.jboss.as.protocol.mgmt.ManagementChannelHandler.executeRequest(ManagementChannelHandler.java:110)
	org.jboss.as.controller.client.impl.AbstractModelControllerClient.executeRequest(AbstractModelControllerClient.java:263)
	org.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:168)
	org.jboss.as.controller.client.impl.AbstractModelControllerClient.executeForResult(AbstractModelControllerClient.java:147)
	org.jboss.as.controller.client.impl.AbstractModelControllerClient.execute(AbstractModelControllerClient.java:75)
	org.jboss.qa.repetitive.cli.worker.ManagementRepeatingWorker.executeCall(ManagementRepeatingWorker.java:158)
	org.jboss.qa.repetitive.cli.worker.ManagementRepeatingWorker.run(ManagementRepeatingWorker.java:97)
	java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	java.lang.Thread.run(Thread.java:745)

      Additional info:
      HPUX:

      mvn -version
Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T15:39:06-04:00)
Maven home: /qa/tools/opt/maven3-latest
Java version: 1.8.0.07-hp-ux, vendor: Hewlett Packard Enterprise
Java home: /qa/tools/opt/hpux_ia/java8_07/jre
Default locale: en_US, platform encoding: UTF8
OS name: "hp-ux", version: "b.11.31", arch: "ia64n", family: "unix"

      hudson@eap-perf-hpux-03.mw.lab.eng.bos.redhat.com:/qa/tools/opt/hpux_ia/java8_07/bin>./java -version
java version "1.8.0.07-hp-ux"
Java(TM) SE Runtime Environment (build 1.8.0.07-hp-ux-b1)
Java HotSpot(TM) Server VM (build 25.07-b1, mixed mode)
hudson@eap-perf-hpux-03.mw.lab.eng.bos.redhat.com:/qa/tools/opt/hpux_ia/java8_07/bin>

      RHEL: 

      $ mvn -version 
Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-03T15:39:06-04:00)
Maven home: /qa/tools/opt/maven3-latest
Java version: 1.8.0_121, vendor: Oracle Corporation
Java home: /qa/tools/opt/x86_64/jdk1.8.0_121/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "2.6.32-696.el6.x86_64", arch: "amd64", family: "unix"

      Attachments

        1. jboss_remoting_client.diff
          4 kB
        2. remoting-patch.diff
          1 kB
        3. thread.dump.jbeap.11859.txt
          21 kB
        4. xnio_patch2.diff
          7 kB
        5. xnio_traces_debug_3.5.diff
          4 kB

        Issue Links

          is caused by

          Bug - A problem that impairs or prevents the functions of the product. JBEAP-11888 (7.1.0) Connection timeout CLI issue on HTTPS, if more cli clients are used in a loop.

          • Critical - To be worked on immediately following BLOCKER issues.
          • Verified
          is related to

          Bug - A problem that impairs or prevents the functions of the product. JBEAP-12031 [GSS](7.1.0) Avoid Remoting resume/suspend read race on server

          • Blocker - To be worked above all other priorities. This term is chosen when the severity of the issue is very high, has no workaround, or the effort for the change is comparatively low. Issues that may be very publicly visible and could generate significant media attention may also drive a higher priority.
          • Verified

          Bug - A problem that impairs or prevents the functions of the product. JBEAP-11888 (7.1.0) Connection timeout CLI issue on HTTPS, if more cli clients are used in a loop.

          • Critical - To be worked on immediately following BLOCKER issues.
          • Verified

          Bug - A problem that impairs or prevents the functions of the product. JBEAP-7962 Client is unable to connect to remote+http://localhost:9990 intermittently (the connection timed out)

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Verified

          Bug - A problem that impairs or prevents the functions of the product. JBEAP-12575 "java.net.BindException: Address already in use" during CLI (CommandContext) connection

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Bug - A problem that impairs or prevents the functions of the product. JBEAP-13647 HPUX: memory leak in XNIO on Server if ssl is used and -d64 is not used

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Activity

            People

              jdenise@redhat.com Jean Francois Denise
              mkopecky@redhat.com Marek Kopecky
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: