Uploaded image for project: 'WildFly'
  1. WildFly
  2. WFLY-10917

Server fails to shutdown when using JGroups encryption

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Critical
    • Resolution: Done
    • 14.0.0.Final
    • 14.0.0.Final
    • Clustering
    • None

    Description

      Affected scenario is perflab_eap-7x-failover-http-session-shutdown-dist-async-auth-asymEncrypt: it is a 4 nodes fail-over scenario where JGroups communication is encrypted asymmetrically:

              <subsystem xmlns="urn:jboss:domain:jgroups:6.0" default-stack="udp">
                  <channels default="ee">
                      <channel name="ee" stack="udp" cluster="ejb"/>
                  </channels>
                  <stacks>
                      <stack name="udp">
                          <transport type="UDP" socket-binding="jgroups-udp"/>
                          <protocol type="PING"/>
                          <protocol type="MERGE3"/>
                          <protocol type="FD_SOCK"/>
                          <protocol type="FD_ALL"/>
                          <protocol type="VERIFY_SUSPECT"/>
                          <protocol type="ASYM_ENCRYPT" xmlns="">
                             <property name="encrypt_entire_message">true</property>
                             <property name="sym_keylength">128</property>
                             <property name="sym_algorithm">AES/ECB/PKCS5Padding</property>
                             <property name="asym_keylength">512</property>
                             <property name="asym_algorithm">RSA</property>
                          </protocol>
                          <protocol type="pbcast.NAKACK2"/>
                          <protocol type="UNICAST3"/>
                          <protocol type="pbcast.STABLE"/>
                          <protocol type="AUTH" xmlns="">
                            <property name="auth_class">org.jgroups.auth.MD5Token</property>
                            <property name="auth_value">MyPassword</property>
                            <property name="token_hash">MD5</property>
                          </protocol>
                          <protocol type="pbcast.GMS"/>
                          <protocol type="UFC"/>
                          <protocol type="MFC"/>
                          <protocol type="FRAG3"/>
                      </stack>
                      <stack name="tcp">
                          <transport type="TCP" socket-binding="jgroups-tcp"/>
                          <socket-protocol type="MPING" socket-binding="jgroups-mping"/>
                          <protocol type="MERGE3"/>
                          <protocol type="FD_SOCK"/>
                          <protocol type="FD_ALL"/>
                          <protocol type="VERIFY_SUSPECT"/>
                          <protocol type="pbcast.NAKACK2"/>
                          <protocol type="UNICAST3"/>
                          <protocol type="pbcast.STABLE"/>
                          <protocol type="pbcast.GMS"/>
                          <protocol type="MFC"/>
                          <protocol type="FRAG3"/>
                      </stack>
                  </stacks>
              </subsystem>
      

      The problem is that, after one node of the cluster is shut down and restarted, the remaining nodes fail to shut-down gracefully and their JVM has to be killed.
      The default shut-down waiting time is 1 minute: it has been extended to 5 but the nodes still fail to shut-down even in 5 minutes.

      Find attached:

      • the complete log of one node failing to shut-down (17293.log)
      • the thread dump of this node just before being killed (after a 5 minutes time-out) (perf20-consoleText.txt)

      The server logs messages like the following (as in JGRP-2282):

      [JBossINF] �[0m�[31m05:36:35,687 ERROR [org.jgroups.protocols.ASYM_ENCRYPT] (thread-14,ejb,perf20) perf20: received message without encrypt header from perf21; dropping it
      [JBossINF] �[0m�[31m05:36:36,668 ERROR [org.jgroups.protocols.ASYM_ENCRYPT] (thread-14,ejb,perf20) perf20: received message without encrypt header from perf21; dropping it
      [JBossINF] �[0m�[31m05:36:36,879 ERROR [org.jgroups.protocols.ASYM_ENCRYPT] (thread-14,ejb,perf20) perf20: received message without encrypt header from perf18; dropping it
      

      before failing to shut-down.

      Attachments

        1. 17293.log
          158 kB
          Tommaso Borgato
        2. perf20-consoleText.txt
          535 kB
          Tommaso Borgato

        Issue Links

          Activity

            People

              pferraro@redhat.com Paul Ferraro
              tborgato@redhat.com Tommaso Borgato
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: