Uploaded image for project: 'Red Hat Data Grid'
  1. Red Hat Data Grid
  2. JDG-6811

SSLSocket blocks on close()

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Blocker
    • RHDG 8.4.x CD
    • None
    • None
    • None
    • False
    • None
    • False

    Description

      During testing cross-site in Keycloak using multiple Gossip Router, killing a single Gossip Router leads to a cluster halt.

      Further investigation reveals threads blocking in Socket.write for a long period (around ~15min - default Kernel timeout) due to the TCP send queue (in Kernel) being full. A synchronization problem revealed that Socket.close was not invoked. See https://issues.redhat.com/browse/JGRP-2746

      After fixing the first issue, a second one arose. The Socket.close was blocked for SSLSockets. This one is a JDK bug: https://bugs.openjdk.org/browse/JDK-8241239

      A workaround exists and it is setting SO_LINGER TCP option. SO_LINGER sets the delay, in seconds, that it waits while data is being transmitted before closing a socket, after a call has been received to close the socket.

      The idea is to enable this option with a 1 or 2 seconds delay. The data in the TCP send queue can be lost, but it will not affect Infinispan. The UNICAST3/NAKACK protocols will ensure message retransmission. (Infinispan JIRA to be created)

      // Operator changes required to set SO_LINGER for TUNNEL (cross-site deployment)

      Attachments

        Issue Links

          is related to

          Feature Request - Feature requests from customers and/or users JGRP-2753 GossipRouter: heartbeating

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. JGRP-2748 SSLSocket blocks on close()

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. JGRP-2751 TCP with SSLSockets: check behavior on close()

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. JGRP-2752 GossipRouter doesn't use some attributes

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) JDG-6828 [Operator] Configure Gossip Route idle connection timeout

          • Blocker - To be worked above all other priorities. This term is chosen when the severity of the issue is very high, has no workaround, or the effort for the change is comparatively low. Issues that may be very publicly visible and could generate significant media attention may also drive a higher priority.
          • Verified

          Component Upgrade - A task tracking an update to a bundled component or revision of component upstream of the project. ISPN-15428 Upgrade JGroups to 5.2.21.Final

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) JGRP-2746 RouterStubManager/RouterStub: remove unneeded synchronization

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved
          relates to

          Enhancement - An enhancement to or refactoring of existing functionality that is not configurable by an end user (typically a change made by an internal team that affects users) ISPN-15501 Add options to configure JGroups bundler and TCP SO_LINGER

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Resolved
          links to

          Web Link Keycloak Issue 675

          Activity

            People

              pruivo@redhat.com Pedro Ruivo
              pruivo@redhat.com Pedro Ruivo
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: