Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-13106

e2e-gcp-operator loadbalancer service not going ready CI flakes

XMLWordPrintable

    • No
    • Sprint 235, Sprint 236, Sprint 237, Sprint 238, CLOUD Sprint 249
    • 5
    • Rejected
    • False
    • Hide

      None

      Show
      None
    • Hide
      * Previously, when you created or deleted large volumes of service objects simultaneously, service controller ability to process each service sequentially would slow down. This caused short timeout issues for the service controller and backlog issues for the objects. With this release, the service controller can now process up to 10 service objects simultaneously to reduce the backlog and timeout issues. (link:https://issues.redhat.com/browse/OCPBUGS-13106[*OCPBUGS-13106*])
      Show
      * Previously, when you created or deleted large volumes of service objects simultaneously, service controller ability to process each service sequentially would slow down. This caused short timeout issues for the service controller and backlog issues for the objects. With this release, the service controller can now process up to 10 service objects simultaneously to reduce the backlog and timeout issues. (link: https://issues.redhat.com/browse/OCPBUGS-13106 [* OCPBUGS-13106 *])
    • Bug Fix
    • Done

      Description of problem:

      Various jobs are failing in e2e-gcp-operator due to the LoadBalancer-Type Service not going "ready", which means it most likely not getting an IP address.

Tests so far affected are:
- TestUnmanagedDNSToManagedDNSInternalIngressController
- TestScopeChange
- TestInternalLoadBalancerGlobalAccessGCP
- TestInternalLoadBalancer
- TestAllowedSourceRanges

For example, in TestInternalLoadBalancer, the Load Balancer never comes back ready:

operator_test.go:1454: Expected conditions: map[Admitted:True Available:True DNSManaged:True DNSReady:True LoadBalancerManaged:True LoadBalancerReady:True]
         Current conditions: map[Admitted:True Available:False DNSManaged:True DNSReady:False Degraded:True DeploymentAvailable:True DeploymentReplicasAllAvailable:True DeploymentReplicasMinAvailable:True DeploymentRollingOut:False EvaluationConditionsDetected:False LoadBalancerManaged:True LoadBalancerProgressing:False LoadBalancerReady:False Progressing:False Upgradeable:True]

Where DNSReady:False and LoadBalancerReady:False.

      Version-Release number of selected component (if applicable):

      4.14

      How reproducible:

      10% of the time

      Steps to Reproduce:

      1. Run e2e-gcp-operator many times until you see one of these failures

      Actual results:

      Test Failure

      Expected results:

      Not failure

      Additional info:

      Search.CI Links:
      TestScopeChange
      TestInternalLoadBalancerGlobalAccessGCP & TestInternalLoadBalancer 

      This does not seem related to https://issues.redhat.com/browse/OCPBUGS-6013. The DNS E2E tests actually pass this same condition check.

            joelspeed Joel Speed
            gspence@redhat.com Grant Spence
            Milind Yadav Milind Yadav
            Jeana Routh Jeana Routh
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

              Created:
              Updated:
              Resolved: