Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-30127

[IBU] - Occasionally the rollback fails with "failed to delete all the backup CRs."

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • 4.16
    • 4.15
    • LCA operator
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • No
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Attempted several upgrade and rollback attempts.

      Although a few times the upgrades/rollbacks were successful, also saw failures.

       

      oc get ibu
      NAME      AGE     DESIRED STAGE   STATE            DETAILS
      upgrade   7h21m   Idle            FinalizeFailed   failed to delete all the backup CRs. Perform cleanup manually then add 'lca.openshift.io/manualCleanupDone' annotation to ibu CR to transition back to Idle 

       

       

       

      oc get ibu upgrade -o yaml
      apiVersion: lca.openshift.io/v1alpha1
      kind: ImageBasedUpgrade
      metadata:
        creationTimestamp: "2024-03-01T06:46:15Z"
        generation: 2
        name: upgrade
        resourceVersion: "89091"
        uid: d50e7b9e-1c31-495f-bead-3706b0079749
      spec:
        additionalImages:
          name: ""
          namespace: ""
        autoRollbackOnFailure:
          disabledForPostRebootConfig: true
          disabledForUpgradeCompletion: true
        oadpContent:
        - name: oadp-cm
          namespace: openshift-adp
        seedImageRef:
          image: quay.io/ocp-edge-qe/ib-seedimage-public:ocp-edge-61
          version: 4.15.0
        stage: Idle
      status:
        conditions:
        - lastTransitionTime: "2024-03-01T06:19:59Z"
          message: Prep completed
          observedGeneration: 3
          reason: Completed
          status: "False"
          type: PrepInProgress
        - lastTransitionTime: "2024-03-01T06:19:59Z"
          message: Prep completed successfully
          observedGeneration: 3
          reason: Completed
          status: "True"
          type: PrepCompleted
        - lastTransitionTime: "2024-03-01T06:36:35Z"
          message: Rollback requested
          observedGeneration: 2
          reason: Failed
          status: "False"
          type: UpgradeInProgress
        - lastTransitionTime: "2024-03-01T06:36:48Z"
          message: Rollback requested
          observedGeneration: 2
          reason: Failed
          status: "False"
          type: UpgradeCompleted
        - lastTransitionTime: "2024-03-01T06:46:16Z"
          message: Rollback completed
          observedGeneration: 1
          reason: Completed
          status: "False"
          type: RollbackInProgress
        - lastTransitionTime: "2024-03-01T06:46:16Z"
          message: Rollback completed
          observedGeneration: 1
          reason: Completed
          status: "True"
          type: RollbackCompleted
        - lastTransitionTime: "2024-03-01T06:46:28Z"
          message: failed to delete all the backup CRs. Perform cleanup manually then add
            'lca.openshift.io/manualCleanupDone' annotation to ibu CR to transition back
            to Idle
          observedGeneration: 2
          reason: FinalizeFailed
          status: "False"
          type: Idle
        observedGeneration: 2
      

       

       

       

              angwang@redhat.com Angie Wang
              achuzhoy@redhat.com Alexander Chuzhoy
              None
              None
              Alexander Chuzhoy Alexander Chuzhoy
              None
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated: