Uploaded image for project: 'Red Hat Fuse'
  1. Red Hat Fuse
  2. ENTESB-6657

Karaf client hung on ensemble servers

    XMLWordPrintable

Details

    • % %

    Description

      Karaf Client Hangs:

      Blocked thread;

      "sshd-SshServer[7d9546c6]-timer-thread-1" prio=10 tid=0x00007fff7c3b2800 nid=0x4487 waiting for monitor entry [0x00007fffdeca5000]
         java.lang.Thread.State: BLOCKED (on object monitor)
      	at org.apache.sshd.common.future.DefaultSshFuture.setValue(DefaultSshFuture.java:166)
      	- waiting to lock <0x0000000743312398> (a java.lang.Object)
      	at org.apache.sshd.common.future.DefaultCloseFuture.setClosed(DefaultCloseFuture.java:44)
      	at org.apache.sshd.common.util.CloseableUtils$4$1.operationComplete(CloseableUtils.java:188)
      	at org.apache.sshd.common.util.CloseableUtils$4$1.operationComplete(CloseableUtils.java:177)
      	at org.apache.sshd.common.future.DefaultSshFuture.notifyListener(DefaultSshFuture.java:261)
      	at org.apache.sshd.common.future.DefaultSshFuture.addListener(DefaultSshFuture.java:212)
      	at org.apache.sshd.common.util.CloseableUtils$4$1.operationComplete(CloseableUtils.java:183)
      	at org.apache.sshd.common.util.CloseableUtils$4$1.operationComplete(CloseableUtils.java:177)
      	at org.apache.sshd.common.future.DefaultSshFuture.notifyListener(DefaultSshFuture.java:261)
      	at org.apache.sshd.common.future.DefaultSshFuture.addListener(DefaultSshFuture.java:212)
      	at org.apache.sshd.common.util.CloseableUtils$4$1.operationComplete(CloseableUtils.java:183)
      	at org.apache.sshd.common.util.CloseableUtils$4$1.operationComplete(CloseableUtils.java:177)
      	at org.apache.sshd.common.util.CloseableUtils$4.close(CloseableUtils.java:192)
      	at org.apache.sshd.common.util.CloseableUtils$AbstractInnerCloseable.doCloseImmediately(CloseableUtils.java:419)
      	at org.apache.sshd.common.session.AbstractSession.doCloseImmediately(AbstractSession.java:447)
      	at org.apache.sshd.common.util.CloseableUtils$AbstractCloseable.close(CloseableUtils.java:350)
      	at org.apache.sshd.common.session.AbstractSession$1.operationComplete(AbstractSession.java:1059)
      	at org.apache.sshd.common.session.AbstractSession$1.operationComplete(AbstractSession.java:1057)
      	at org.apache.sshd.common.future.DefaultSshFuture.notifyListener(DefaultSshFuture.java:261)
      	at org.apache.sshd.common.future.DefaultSshFuture.addListener(DefaultSshFuture.java:212)
      	at org.apache.sshd.common.session.AbstractSession.disconnect(AbstractSession.java:1057)
      	at org.apache.sshd.server.session.ServerSession.checkForTimeouts(ServerSession.java:97)
      	at org.apache.sshd.server.session.ServerSessionTimeoutListener.run(ServerSessionTimeoutListener.java:57)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
         Locked ownable synchronizers:
      	- <0x0000000740d7bcb0> (a java.util.concurrent.ThreadPoolExecutor$Worker)
      

      Running thread; The running thread seems to be waiting to authenticate:

      "sshd-SshServer[7d9546c6]-nio2-thread-1" prio=10 tid=0x00007fff9c004800 nid=0x456f in Object.wait() [0x00007fffd5bd8000]
         java.lang.Thread.State: WAITING (on object monitor)
      	at java.lang.Object.wait(Native Method)
      	- waiting on <0x0000000743310268> (a java.lang.Object)
      	at java.lang.Object.wait(Object.java:503)
      	at org.apache.sshd.common.future.DefaultSshFuture.await(DefaultSshFuture.java:60)
      	- locked <0x0000000743310268> (a java.lang.Object)
      	at org.apache.sshd.client.session.ClientUserAuthServiceOld.readyForAuth(ClientUserAuthServiceOld.java:113)
      	at org.apache.sshd.client.session.ClientUserAuthServiceOld.auth(ClientUserAuthServiceOld.java:182)
      	- locked <0x0000000743310268> (a java.lang.Object)
      	at org.apache.sshd.client.session.ClientUserAuthService.auth(ClientUserAuthService.java:109)
      	at org.apache.sshd.client.session.ClientSessionImpl.tryAuth(ClientSessionImpl.java:159)
      	- locked <0x0000000743310268> (a java.lang.Object)
      	at org.apache.sshd.client.session.ClientSessionImpl.authPassword(ClientSessionImpl.java:145)
      	at io.fabric8.commands.ContainerConnect.executSshCommand(ContainerConnect.java:154)
      	at io.fabric8.commands.ContainerConnect.doExecute(ContainerConnect.java:95)
      	at org.apache.karaf.shell.console.OsgiCommandSupport.execute(OsgiCommandSupport.java:39)
      	at org.apache.felix.gogo.commands.basic.AbstractCommand.execute(AbstractCommand.java:35)
      	at org.apache.felix.gogo.runtime.CommandProxy.execute(CommandProxy.java:78)
      	at org.apache.felix.gogo.runtime.Closure.executeCmd(Closure.java:477)
      	at org.apache.felix.gogo.runtime.Closure.executeStatement(Closure.java:403)
      	at org.apache.felix.gogo.runtime.Pipe.run(Pipe.java:108)
      	at org.apache.felix.gogo.runtime.Closure.execute(Closure.java:183)
      	at org.apache.felix.gogo.runtime.Closure.execute(Closure.java:120)
      	at org.apache.felix.gogo.runtime.CommandSessionImpl.execute(CommandSessionImpl.java:89)
      	at org.apache.karaf.shell.ssh.ShellCommandFactory$ShellCommand$1.run(ShellCommandFactory.java:117)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at org.apache.karaf.jaas.modules.JaasHelper.doAs(JaasHelper.java:67)
      	at org.apache.karaf.shell.ssh.ShellCommandFactory$ShellCommand.start(ShellCommandFactory.java:115)
      	at org.apache.sshd.server.channel.ChannelSession.handleExec(ChannelSession.java:422)
      	at org.apache.sshd.server.channel.ChannelSession.handleRequest(ChannelSession.java:304)
      	at org.apache.sshd.server.channel.ChannelSession$ChannelSessionRequestHandler.process(ChannelSession.java:576)
      	at org.apache.sshd.server.channel.ChannelSession$ChannelSessionRequestHandler.process(ChannelSession.java:574)
      	at org.apache.sshd.common.channel.AbstractChannel.handleRequest(AbstractChannel.java:96)
      	at org.apache.sshd.common.session.AbstractConnectionService.channelRequest(AbstractConnectionService.java:261)
      	at org.apache.sshd.common.session.AbstractConnectionService.process(AbstractConnectionService.java:139)
      	at org.apache.sshd.common.session.AbstractSession.doHandleMessage(AbstractSession.java:399)
      	at org.apache.sshd.common.session.AbstractSession.handleMessage(AbstractSession.java:295)
      	- locked <0x0000000743312398> (a java.lang.Object)
      	at org.apache.sshd.common.session.AbstractSession.decode(AbstractSession.java:731)
      	at org.apache.sshd.common.session.AbstractSession.messageReceived(AbstractSession.java:277)
      	- locked <0x0000000743325880> (a java.lang.Object)
      	at org.apache.sshd.common.AbstractSessionIoHandler.messageReceived(AbstractSessionIoHandler.java:54)
      	at org.apache.sshd.common.io.nio2.Nio2Session$1.onCompleted(Nio2Session.java:187)
      	at org.apache.sshd.common.io.nio2.Nio2Session$1.onCompleted(Nio2Session.java:173)
      	at org.apache.sshd.common.io.nio2.Nio2CompletionHandler$1.run(Nio2CompletionHandler.java:32)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at org.apache.sshd.common.io.nio2.Nio2CompletionHandler.completed(Nio2CompletionHandler.java:30)
      	at sun.nio.ch.Invoker.invokeUnchecked(Invoker.java:126)
      	at sun.nio.ch.Invoker$2.run(Invoker.java:218)
      	at sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      	at java.lang.Thread.run(Thread.java:745)
         Locked ownable synchronizers:
      	- <0x000000074203cb70> (a java.util.concurrent.ThreadPoolExecutor$Worker)
      

      Attachments

        Issue Links

          Activity

            People

              ggrzybek Grzegorz Grzybek
              rhn-support-mrobson Matt Robson
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: