Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-60844

alert/OVNKubernetesResourceRetryFailure firing on GCP

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • Approved
    • CORENET Sprint 276
    • 1
    • In Progress
    • Release Note Not Required
    • N/A
    • None
    • None
    • None
    • None

      (Feel free to update this bug's summary to be more specific.)
      Component Readiness has found a potential regression in the following test:

      [bz-networking][invariant] alert/OVNKubernetesResourceRetryFailure should not be at or above info

      Significant regression detected.
      Fishers Exact probability of a regression: 100.00%.
      Test pass rate dropped from 100.00% to 94.59%.

      Sample (being evaluated) Release: 4.20
      Start Time: 2025-08-18T00:00:00Z
      End Time: 2025-08-25T08:00:00Z
      Success Rate: 94.59%
      Successes: 280
      Failures: 16
      Flakes: 0
      Base (historical) Release: 4.17
      Start Time: 2024-09-01T00:00:00Z
      End Time: 2024-10-01T00:00:00Z
      Success Rate: 100.00%
      Successes: 972
      Failures: 0
      Flakes: 0

      View the test details report for additional context.

      This is just barely below the 5% pass rate drop before we flag a regression, but looking at the chart it's very clearly worse.

      This happened at the end of 4.19 as well causing mass problems, first via a regression in cpu use for ovn, but then later the alert kept firing just due to general CPU overload problems.

      I checked some runs and did not see overlap with high cpu alerts, but it's unclear if this is sufficient to rule out general CPU overlad. I would check prom to confirm at the time this is happening.

      Filed by: dgoodwin@redhat.com

              jcaamano@redhat.com Jaime CaamaƱo Ruiz
              openshift-trt OpenShift Technical Release Team
              None
              None
              Weibin Liang Weibin Liang
              None
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated: