Uploaded image for project: 'JGroups'
  1. JGroups
  2. JGRP-2494

DNS_PING and failed probes

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Major Major
    • None
    • 4.1.9
    • None
    • Fixed by using a later version
    • Hide

      logs are below showing the DNS_PING query where the two entries are found - port 8888 is the web port, port 8889 is the jgroups port.  Undertow logs a failure for the probe at DEBUG level, but jgroups is logging the failed probe at ERROR level.

       

      2020-07-22 17:51:03,356 DEBUG [org.jgroups.protocols.dns.DNS_PING] (thread-5,null,463dfca1ff73) 463dfca1ff73: entries collected from DNS (in 3 ms): [172.29.11.55:8889, 172.29.11.55:8888]2020-07-22 17:51:03,356 DEBUG [org.jgroups.protocols.dns.DNS_PING] (thread-5,null,463dfca1ff73) 463dfca1ff73: entries collected from DNS (in 3 ms): [172.29.11.55:8889, 172.29.11.55:8888]2020-07-22 17:51:03,356 DEBUG [org.jgroups.protocols.dns.DNS_PING] (thread-5,null,463dfca1ff73) 463dfca1ff73: sending discovery requests to [172.29.11.55:8889, 172.29.11.55:8888]2020-07-22 17:51:03,357 DEBUG [io.undertow.request.io] (default I/O-2) UT005014: Failed to parse request: io.undertow.util.BadRequestException: UT000165: Invalid character  in request-target at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpRequestParser.handlePath(HttpRequestParser.java:389) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpRequestParser.handle(HttpRequestParser.java:248) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpReadListener.handleEventWithNoRunningRequest(HttpReadListener.java:187) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpReadListener.handleEvent(HttpReadListener.java:136) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpOpenListener.handleEvent(HttpOpenListener.java:162) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpOpenListener.handleEvent(HttpOpenListener.java:100) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpOpenListener.handleEvent(HttpOpenListener.java:57) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners$10.handleEvent(ChannelListeners.java:291) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners$10.handleEvent(ChannelListeners.java:286) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92) at org.jboss.xnio.nio@3.7.7.Final//org.xnio.nio.QueuedNioTcpServer2.acceptTask(QueuedNioTcpServer2.java:178) at org.jboss.xnio.nio@3.7.7.Final//org.xnio.nio.WorkerThread.safeRun(WorkerThread.java:612) at org.jboss.xnio.nio@3.7.7.Final//org.xnio.nio.WorkerThread.run(WorkerThread.java:479) 2020-07-22 17:51:03,358 ERROR [org.jgroups.protocols.TCP] (Connection.Receiver [172.17.0.10:57508 - 172.29.11.55:8888]-22,ejb,463dfca1ff73) JGRP000030: 463dfca1ff73: failed handling incoming message: java.io.EOFException at java.base/java.io.DataInputStream.readFully(DataInputStream.java:202) at org.jgroups@4.1.9.Final//org.jgroups.util.Util.readMessageBatch(Util.java:1226) at org.jgroups@4.1.9.Final//org.jgroups.protocols.TP.handleMessageBatch(TP.java:1448) at org.jgroups@4.1.9.Final//org.jgroups.protocols.TP.receive(TP.java:1440) at org.jgroups@4.1.9.Final//org.jgroups.blocks.cs.BaseServer.receive(BaseServer.java:171) at org.jgroups@4.1.9.Final//org.jgroups.blocks.cs.TcpConnection$Receiver.run(TcpConnection.java:300) at org.jboss.as.clustering.common@19.1.0.Final//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49) at org.jboss.as.clustering.common@19.1.0.Final//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70) at java.base/java.lang.Thread.run(Thread.java:834)

       

       

      Show
      logs are below showing the DNS_PING query where the two entries are found - port 8888 is the web port, port 8889 is the jgroups port.  Undertow logs a failure for the probe at DEBUG level, but jgroups is logging the failed probe at ERROR level.   2020-07-22 17:51:03,356 DEBUG [org.jgroups.protocols.dns.DNS_PING] (thread-5, null ,463dfca1ff73) 463dfca1ff73: entries collected from DNS (in 3 ms): [172.29.11.55:8889, 172.29.11.55:8888]2020-07-22 17:51:03,356 DEBUG [org.jgroups.protocols.dns.DNS_PING] (thread-5, null ,463dfca1ff73) 463dfca1ff73: entries collected from DNS (in 3 ms): [172.29.11.55:8889, 172.29.11.55:8888]2020-07-22 17:51:03,356 DEBUG [org.jgroups.protocols.dns.DNS_PING] (thread-5, null ,463dfca1ff73) 463dfca1ff73: sending discovery requests to [172.29.11.55:8889, 172.29.11.55:8888]2020-07-22 17:51:03,357 DEBUG [io.undertow.request.io] ( default I/O-2) UT005014: Failed to parse request: io.undertow.util.BadRequestException: UT000165: Invalid character  in request-target at io.undertow.core@2.1.0.Final //io.undertow.server.protocol.http.HttpRequestParser.handlePath(HttpRequestParser.java:389) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpRequestParser.handle(HttpRequestParser.java:248) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpReadListener.handleEventWithNoRunningRequest(HttpReadListener.java:187) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpReadListener.handleEvent(HttpReadListener.java:136) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpOpenListener.handleEvent(HttpOpenListener.java:162) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpOpenListener.handleEvent(HttpOpenListener.java:100) at io.undertow.core@2.1.0.Final//io.undertow.server.protocol.http.HttpOpenListener.handleEvent(HttpOpenListener.java:57) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners$10.handleEvent(ChannelListeners.java:291) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners$10.handleEvent(ChannelListeners.java:286) at org.jboss.xnio@3.7.7.Final//org.xnio.ChannelListeners.invokeChannelListener(ChannelListeners.java:92) at org.jboss.xnio.nio@3.7.7.Final//org.xnio.nio.QueuedNioTcpServer2.acceptTask(QueuedNioTcpServer2.java:178) at org.jboss.xnio.nio@3.7.7.Final//org.xnio.nio.WorkerThread.safeRun(WorkerThread.java:612) at org.jboss.xnio.nio@3.7.7.Final//org.xnio.nio.WorkerThread.run(WorkerThread.java:479) 2020-07-22 17:51:03,358 ERROR [org.jgroups.protocols.TCP] (Connection.Receiver [172.17.0.10:57508 - 172.29.11.55:8888]-22,ejb,463dfca1ff73) JGRP000030: 463dfca1ff73: failed handling incoming message: java.io.EOFException at java.base/java.io.DataInputStream.readFully(DataInputStream.java:202) at org.jgroups@4.1.9.Final//org.jgroups.util.Util.readMessageBatch(Util.java:1226) at org.jgroups@4.1.9.Final//org.jgroups.protocols.TP.handleMessageBatch(TP.java:1448) at org.jgroups@4.1.9.Final//org.jgroups.protocols.TP.receive(TP.java:1440) at org.jgroups@4.1.9.Final//org.jgroups.blocks.cs.BaseServer.receive(BaseServer.java:171) at org.jgroups@4.1.9.Final//org.jgroups.blocks.cs.TcpConnection$Receiver.run(TcpConnection.java:300) at org.jboss.as.clustering.common@19.1.0.Final//org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49) at org.jboss.as.clustering.common@19.1.0.Final//org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70) at java.base/java.lang. Thread .run( Thread .java:834)    

      Using DNS_PING in a DC/OS (marathon) deployment, there are two SRV records returned - one for the web port and one for the jgroups port.  When the discovery request is sent, an exception is thrown and logged.  The clustering is working, but logs are filling up due to the exception happening and being logged frequently.

        1. JGRP-2494.txt
          3 kB
          Dewayne McNair

              rhn-engineering-bban Bela Ban
              dewaynemcnair Dewayne McNair (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: