Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-60945

NewOLM catalog install test has regressed in 4.20

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • Approved
    • Pikachu Sprint 276
    • 1
    • Done
    • Release Note Not Required
    • None
    • None
    • None
    • None
    • None

      (Feel free to update this bug's summary to be more specific.)
      Component Readiness has found a potential regression in the following test:

      [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 New Catalog Install should fail to install if it has an invalid reference [Suite:openshift/conformance/parallel]

      Sample (being evaluated) Release: 4.20
      Start Time: 2025-08-13T00:00:00Z
      End Time: 2025-08-27T12:00:00Z
      Success Rate: 97.19%
      Successes: 311
      Failures: 9
      Flakes: 0
      Base (historical) Release: 4.19
      Start Time: 2025-05-18T00:00:00Z
      End Time: 2025-06-17T23:59:59Z
      Success Rate: 100.00%
      Successes: 853
      Failures: 0
      Flakes: 0

      View the test details report for additional context.

      This two week sample size show that this test appears to have begun failing where it did not before.

      Note that the newer failed runs are colliding with another ongoing issue, the older ones are cleaner in that they fail on just this test sometimes.

      This just appeared because we allow a 5% drop in pass rate, and we just hit the threshold, yet it's very clear something has changed here. This should be a release blocker even if it does disappear on the board.

      Failure message:

      [sig-olmv1][OCPFeatureGate:NewOLM][Skipped:Disconnected] OLMv1 New Catalog Install should fail to install if it has an invalid reference expand_less 	0s
{  fail [/build/openshift/tests-extension/test/olmv1-catalog.go:210]: failed to create ClusterCatalog
Unexpected error:
    <*fmt.wrapError | 0xc0002a82c0>: 
    failed to create ClusterCatalog: object is being deleted: clustercatalogs.olm.operatorframework.io "bad-catalog" already exists
    {
        msg: "failed to create ClusterCatalog: object is being deleted: clustercatalogs.olm.operatorframework.io \"bad-catalog\" already exists",
        err: <*errors.StatusError | 0xc000594e60>{
            ErrStatus: {
                TypeMeta: {Kind: "", APIVersion: ""},
                ListMeta: {
                    SelfLink: "",
                    ResourceVersion: "",
                    Continue: "",
                    RemainingItemCount: nil,
                },
                Status: "Failure",
                Message: "object is being deleted: clustercatalogs.olm.operatorframework.io \"bad-catalog\" already exists",
                Reason: "AlreadyExists",
                Details: {
                    Name: "bad-catalog",
                    Group: "olm.operatorframework.io",
                    Kind: "clustercatalogs",
                    UID: "",
                    Causes: nil,
                    RetryAfterSeconds: 0,
                },
                Code: 409,
            },
        },
    }
occurred}

      Filed by: dgoodwin@redhat.com

              rh-ee-cmacedo Camila Macedo
              openshift-trt OpenShift Technical Release Team
              None
              None
              Jian Zhang Jian Zhang
              None
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: