Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-31479

Installed Operators in "Failed" status after upgrading to 4.15.3

    • Critical
    • No
    • Quality OLM Sprint 251, Rasputin OLM Sprint 252
    • 2
    • Rejected
    • False
    • Hide

      None

      Show
      None
    • Allows OLM to update or create the auth-reader RoleBinding without needing to check for presence. This allows OLM to bypass issues found with the labeler introduced in 4.15 for performance improvements while we investigate root cause.
    • Bug Fix
    • In Progress

      Description of problem:

      We upgraded our OpenShift Cluster from 4.4.16 to 4.15.3 and multiple operators are now in "Failed" status with the following CSV conditions such as:
      - NeedsReinstall installing: deployment changed old hash=5f6b8fc6f7, new hash=5hFv6Gemy1Zri3J9ulXfjG9qOzoFL8FMsLNcLR
      - InstallComponentFailed install strategy failed: rolebindings.rbac.authorization.k8s.io "openshift-gitops-operator-controller-manager-service-auth-reader" already exists
      
      All other failures refer to a similar "auth-reader" rolebinding that already exist.
       
          

      Version-Release number of selected component (if applicable):

      OpenShift 4.15.3
          

      How reproducible:

      Happened on several installed operators but on the only cluster we upgraded (our staging cluster)
          

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

          

      Expected results:

      All operators should be up-to-date
          

      Additional info:

      This may be related to https://github.com/operator-framework/operator-lifecycle-manager/pull/3159 
          

            [OCPBUGS-31479] Installed Operators in "Failed" status after upgrading to 4.15.3

            Daniel Franz created issue -
            Daniel Franz made changes -
            Link New: This issue clones OCPBUGS-31080 [ OCPBUGS-31080 ]
            OpenShift Jira Bot made changes -
            Assignee Original: Daniel Franz [ rh-ee-dfranz ] New: Alexander Greene [ agreene1991 ]
            Daniel Franz made changes -
            Link New: This issue depends on OCPBUGS-31080 [ OCPBUGS-31080 ]
            Daniel Franz made changes -
            Sprint New: Q* OLM Sprint 251 [ 60304 ]
            Target Backport Versions Original: 4.15.0 [ 12407353 ]
            Target Version Original: 4.16.0 [ 12417855 ] New: 4.15.0 [ 12407353 ]
            OpenShift Prow Bot made changes -
            Remote Link New: This issue links to "openshift/operator-framework-olm#721: [release-4.15] OCPBUGS-31479: Rolebinding SSA cherry-pick (Web Link)" [ 1595494 ]
            Kui Wang made changes -
            Assignee Original: Alexander Greene [ agreene1991 ] New: Daniel Franz [ rh-ee-dfranz ]
            Joep van Delft made changes -
            Target Version Original: 4.15.0 [ 12407353 ] New: 4.15.z [ 12417803 ]
            OpenShift Prow Bot made changes -
            Status Original: New [ 10016 ] New: POST [ 15726 ]
            Di Wang made changes -
            Link New: This issue blocks APPSRE-8670 [ APPSRE-8670 ]
            Portfolio Life Cycle Management Automation Bot made changes -
            PX Impact Score Original: 8244 New: 6092
            OpenShift Prow Bot made changes -
            Remote Link Original: This issue links to "openshift/operator-framework-olm#721: [release-4.15] OCPBUGS-31479: Rolebinding SSA cherry-pick (Web Link)" [ 1595494 ]
            OpenShift Prow Bot made changes -
            Status Original: POST [ 15726 ] New: New [ 10016 ]
            Daniel Franz made changes -
            Status Original: New [ 10016 ] New: ASSIGNED [ 14452 ]
            Daniel Franz made changes -
            Link New: This issue is duplicated by OCPBUGS-31073 [ OCPBUGS-31073 ]
            Daniel Franz made changes -
            Link New: This issue is duplicated by OCPBUGS-28845 [ OCPBUGS-28845 ]
            Daniel Franz made changes -
            Severity New: Critical [ 26750 ]
            Petr Muller made changes -
            Labels Original: triaged New: ImpactStatementRequested UpgradeBlocker triaged
            Petr Muller made changes -
            Link New: This issue is blocked by OPRUN-3267 [ OPRUN-3267 ]
            Kevin Rizza made changes -
            Sprint Original: Quality OLM Sprint 251 [ 60304 ] New: Quality OLM Sprint 251, Refinement Backlog 2 [ 60304, 60729 ]
            Portfolio Life Cycle Management Automation Bot made changes -
            PX Impact Score Original: 6092 New: 6124
            Portfolio Life Cycle Management Automation Bot made changes -
            PX Impact Score Original: 6124 New: 6136
            OpenShift Prow Bot made changes -
            Remote Link New: This issue links to "openshift/operator-framework-olm#721: [release-4.15] OCPBUGS-31479: Rolebinding SSA cherry-pick (Web Link)" [ 1608875 ]
            Daniel Franz made changes -
            Link New: This issue is documented by OPRUN-3267 [ OPRUN-3267 ]
            Daniel Franz made changes -
            Link Original: This issue is blocked by OPRUN-3267 [ OPRUN-3267 ]
            Daniel Franz made changes -
            Release Note Status New: In Progress [ 30960 ]
            Release Note Text New: Allows OLM to update or create the auth-reader RoleBinding without needing to check for presence. This allows OLM to bypass issues found with the labeler introduced in 4.15 for performance improvements while we investigate root cause.
            Release Note Type New: Bug Fix [ 30950 ]
            Portfolio Life Cycle Management Automation Bot made changes -
            PX Impact Score Original: 6136 New: 8210
            OpenShift Prow Bot made changes -
            Remote Link Original: This issue links to "openshift/operator-framework-olm#721: [release-4.15] OCPBUGS-31479: Rolebinding SSA cherry-pick (Web Link)" [ 1608875 ]
            OpenShift Prow Bot made changes -
            Status Original: ASSIGNED [ 14452 ] New: New [ 10016 ]
            W. Trevor King made changes -
            Labels Original: ImpactStatementRequested UpgradeBlocker triaged New: UpdateRecommendationsBlocked UpgradeBlocker triaged
            Portfolio Life Cycle Management Automation Bot made changes -
            PX Impact Score Original: 8210 New: 8208
            OpenShift Prow Bot made changes -
            Status Original: New [ 10016 ] New: MODIFIED [ 14454 ]
            Kevin Rizza made changes -
            Link New: This issue is cloned by OCPBUGS-32311 [ OCPBUGS-32311 ]
            Kevin Rizza made changes -
            Target Version Original: 4.15.z [ 12417803 ] New: 4.16.0 [ 12417855 ]
            Kevin Rizza made changes -
            Target Backport Versions New: 4.15.z [ 12417803 ]
            Kevin Rizza made changes -
            Link New: This issue is depended on by OCPBUGS-32311 [ OCPBUGS-32311 ]
            ART Bot made changes -
            Status Original: MODIFIED [ 14454 ] New: ON_QA [ 15723 ]
            Portfolio Life Cycle Management Automation Bot made changes -
            PX Impact Score Original: 8208 New: 8238
            Kui Wang made changes -
            Link Original: This issue is duplicated by OCPBUGS-31073 [ OCPBUGS-31073 ]
            Kui Wang made changes -
            Status Original: ON_QA [ 15723 ] New: Verified [ 10015 ]
            OpenShift Jira Automation Bot made changes -
            Priority Original: Blocker [ 1 ] New: Critical [ 2 ]
            Errata Tool made changes -
            Remote Link New: This issue links to "RHEA-2024:0041 (Web Link)" [ 1627365 ]
            Scott Dodson made changes -
            Summary Original: [4.15] Installed Operators in "Failed" status after upgrading to 4.15.3 New: Installed Operators in "Failed" status after upgrading to 4.15.3
            Scott Dodson made changes -
            Fix Version/s New: 4.16.0 [ 12417855 ]
            Resolution New: Done [ 1 ]
            Status Original: Verified [ 10015 ] New: Closed [ 6 ]
            Robert Bohne made changes -
            Labels Original: UpdateRecommendationsBlocked UpgradeBlocker triaged New: UpdateRecommendationsBlocked UpgradeBlocker muc-coe-lab triaged
            Jian Zhang made changes -
            Fix Version/s New: 4.15.z [ 12417803 ]
            Fix Version/s Original: 4.16.0 [ 12417855 ]
            Jian Zhang made changes -
            Target Version Original: 4.16.0 [ 12417855 ] New: 4.15.z [ 12417803 ]
            Jian Zhang made changes -
            Target Backport Versions Original: 4.15.z [ 12417803 ]
            Kui Wang made changes -
            Labels Original: UpdateRecommendationsBlocked UpgradeBlocker muc-coe-lab triaged New: UpdateRecommendationsBlocked UpgradeBlocker muc-coe-lab pre-merge-tested triaged
            Antonio Carlos Royo made changes -
            Link New: This issue relates to OCPBUGS-49768 [ OCPBUGS-49768 ]

              rh-ee-dfranz Daniel Franz
              xcoulon@redhat.com Xavier Coulon
              Kui Wang Kui Wang
              Votes:
              3 Vote for this issue
              Watchers:
              25 Start watching this issue

                Created:
                Updated:
                Resolved: