Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-32437

[release-4.14] Ingress traffic degradation after upgrade to 4.14

XMLWordPrintable

    • +
    • Critical
    • Yes
    • 1
    • Sprint 252
    • 1
    • Rejected
    • False
    • Hide

      None

      Show
      None
    • Mitigate the issue encountered with certain HTTP clients, notably the Apache HTTP client, where closed idle connections are erroneously reused.
    • Bug Fix
    • Proposed

      This is a clone of issue OCPBUGS-32044. The following is the description of the original issue:

      Description of problem:

      We have an escalation for a customer case where after upgrading to OCP 4.14 they started to see application traffic degradation that seems to be related to the new version of the HAProxy that changed from 2.2.24 to 2.6.13. 
      
      Was already tested by the customer that if the router pods use the old haproxy-router image from OCP 4.12 the issue disappears.
      
      What was observed is that router pods unexpectedly close HTTP keep-alive connection sending a FIN packet while the client is still sending HTTP requests.
      
      

      Version-Release number of selected component (if applicable):

      4.14.16 (HAProxy 2.6)

      How reproducible:

      Only on customer clusters.

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

      Router pods are unexpectedly terminating Keep-alive connections.

      Expected results:

      Router pods should not terminate a keep-live connection when requests are still coming.

      Additional info:

      - Was already tried to change the hard-stop to 20m
      - Was already tried to change the reload interval to the maximum (2m)
      - Was already tried to set `no option idle-close-on-response` in the defualt section of the HAProxy configuration
      - Was already verified that content-length headers have a value grater than 0 in the HTTP requests.
      

              alebedev@redhat.com Andrey Lebedev
              openshift-crt-jira-prow OpenShift Prow Bot
              Melvin Joseph Melvin Joseph
              Andrew McDermott
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

                Created:
                Updated:
                Resolved: