Uploaded image for project: 'OpenShift Console'
  1. OpenShift Console
  2. CONSOLE-4456

Console UI could not work when user submit second y stream upgrade while another upgrade is in progress

XMLWordPrintable

    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • None
    • None
    • None

      Reproduce steps:

      1. Install a ocp 4.17 cluster
      2. Upgrade to OCP 4.18 (make sure it includes https://issues.redhat.com/browse/OTA-861)
      3. Upgrade to 4.19 before above upgrade finished

       

      Expected Result:
      1. Console UI should display there is a blocked upgrade ( to 4.19),

      2. and still can display the progress bars for 4.17 to 4.18.

       

      Observed Result:
      1. Console UI shows a warning bar: This cluster should not be upgrade to 4.18.

      2. All progress bars disappeared

      3. Here is the cv/version yaml when console UI not work:

      [jianl@jianl-thinkpadt14gen4 417]$ oc get clusterversion version -oyaml
      apiVersion: config.openshift.io/v1
      kind: ClusterVersion
      metadata:
        creationTimestamp: "2025-01-27T05:09:18Z"
        generation: 5
        name: version
        resourceVersion: "36626"
        uid: 38a7a0a7-3226-4659-844d-3e03e9111028
      spec:
        clusterID: 99854138-e415-4609-bc0b-b13f04f163b1
        desiredUpdate:
          architecture: ""
          force: false
          image: quay.io/openshift-release-dev/ocp-release@sha256:aa3e0a3a94babd90535f8298ab274b51a9bce6045dda8c3c8cd742bc59f0e2d9
          version: ""
      status:
        availableUpdates: null
        capabilities:
          enabledCapabilities:
          - Build
          - CSISnapshot
          - CloudControllerManager
          - CloudCredential
          - Console
          - DeploymentConfig
          - ImageRegistry
          - Ingress
          - Insights
          - MachineAPI
          - NodeTuning
          - OperatorLifecycleManager
          - OperatorLifecycleManagerV1
          - Storage
          - baremetal
          - marketplace
          - openshift-samples
          knownCapabilities:
          - Build
          - CSISnapshot
          - CloudControllerManager
          - CloudCredential
          - Console
          - DeploymentConfig
          - ImageRegistry
          - Ingress
          - Insights
          - MachineAPI
          - NodeTuning
          - OperatorLifecycleManager
          - OperatorLifecycleManagerV1
          - Storage
          - baremetal
          - marketplace
          - openshift-samples
        conditions:
        - lastTransitionTime: "2025-01-27T05:10:04Z"
          message: The update channel has not been configured.
          reason: NoChannel
          status: "False"
          type: RetrievedUpdates
        - lastTransitionTime: "2025-01-27T05:10:04Z"
          message: Capabilities match configured spec
          reason: AsExpected
          status: "False"
          type: ImplicitlyEnabledCapabilities
        - lastTransitionTime: "2025-01-27T05:54:48Z"
          message: |-
            Preconditions failed for payload loaded version="4.19.0-ec.1" image="quay.io/openshift-release-dev/ocp-release@sha256:aa3e0a3a94babd90535f8298ab274b51a9bce6045dda8c3c8cd742bc59f0e2d9": Multiple precondition checks failed:
            * Precondition "ClusterVersionUpgradeable" failed because of "MultipleReasons": Cluster should not be upgraded between minor versions for multiple reasons: KubeletMinorVersion_KubeletMinorVersionUnsupportedNextUpgrade,UpdateInProgress
            * Cluster operator kube-apiserver should not be upgraded between minor versions: KubeletMinorVersionUpgradeable: Kubelet minor versions on 6 nodes will not be supported in the next OpenShift minor version upgrade.
            * An update is already in progress and the details are in the Progressing condition
            * Precondition "ClusterVersionRecommendedUpdate" failed because of "NoChannel": Configured channel is unset, so the recommended status of updating from 4.18.0-0.test-2025-01-27-021124-ci-ln-4d1ld22-latest to 4.19.0-ec.1 is unknown.
          reason: PreconditionChecks
          status: "False"
          type: ReleaseAccepted
        - lastTransitionTime: "2025-01-27T05:33:20Z"
          message: Done applying 4.17.0-0.test-2025-01-27-045631-ci-ln-f74xh12-latest
          status: "True"
          type: Available
        - lastTransitionTime: "2025-01-27T05:52:39Z"
          status: "False"
          type: Failing
        - lastTransitionTime: "2025-01-27T05:52:31Z"
          message: 'Working towards 4.18.0-0.test-2025-01-27-021124-ci-ln-4d1ld22-latest:
            111 of 902 done (12% complete), waiting on etcd, kube-apiserver'
          reason: ClusterOperatorsUpdating
          status: "True"
          type: Progressing
        - lastTransitionTime: "2025-01-27T05:52:31Z"
          message: |-
            Cluster should not be upgraded between minor versions for multiple reasons: KubeletMinorVersion_KubeletMinorVersionUnsupportedNextUpgrade,UpdateInProgress
            * Cluster operator kube-apiserver should not be upgraded between minor versions: KubeletMinorVersionUpgradeable: Kubelet minor versions on 6 nodes will not be supported in the next OpenShift minor version upgrade.
            * An update is already in progress and the details are in the Progressing condition
          reason: MultipleReasons
          status: "False"
          type: Upgradeable
        - lastTransitionTime: "2025-01-27T05:54:49Z"
          message: 'Cluster operator kube-apiserver should not be upgraded between minor
            versions: KubeletMinorVersionUpgradeable: Kubelet minor versions on 6 nodes
            will not be supported in the next OpenShift minor version upgrade.'
          reason: KubeletMinorVersion_KubeletMinorVersionUnsupportedNextUpgrade
          status: "False"
          type: UpgradeableClusterOperators
        - lastTransitionTime: "2025-01-27T05:54:49Z"
          message: An update is already in progress and the details are in the Progressing
            condition
          reason: UpdateInProgress
          status: "True"
          type: UpgradeableUpgradeInProgress
        desired:
          image: registry.build05.ci.openshift.org/ci-ln-4d1ld22/release@sha256:a31b94abe725c462b444d0524dbf4ed4696d9d8175989c57e376eaac9d64854f
          version: 4.18.0-0.test-2025-01-27-021124-ci-ln-4d1ld22-latest
        history:
        - completionTime: null
          image: registry.build05.ci.openshift.org/ci-ln-4d1ld22/release@sha256:a31b94abe725c462b444d0524dbf4ed4696d9d8175989c57e376eaac9d64854f
          startedTime: "2025-01-27T05:52:31Z"
          state: Partial
          verified: false
          version: 4.18.0-0.test-2025-01-27-021124-ci-ln-4d1ld22-latest
        - completionTime: "2025-01-27T05:33:20Z"
          image: registry.build05.ci.openshift.org/ci-ln-f74xh12/release@sha256:58511cc3abf586b7b76c4389234aea79c5531888c9a89e24cc322c29e291a8e5
          startedTime: "2025-01-27T05:10:04Z"
          state: Completed
          verified: false
          version: 4.17.0-0.test-2025-01-27-045631-ci-ln-f74xh12-latest
        observedGeneration: 4
        versionHash: Qtwk4PYuYRA=
      [jianl@jianl-thinkpadt14gen4 417]$ 

      Attached logs are from below test scenarios:

      1. OTA-861_y_y.txt: 4.17 nightly -> 4.18 (build 4.18,openshift/cluster-version-operator#1139) -> 4.19.0-ec.1
      2. OTA-861_y_y_2.txt: 4.17 (launch 4.17,openshift/cluster-version-operator#1139 aws) -> 4.18 (build 4.18,openshift/cluster-version-operator#1139) -> 4.19.0-ec.1
      3.  

      cc rhn-support-yapei hongkliu afri@afri.cz 

        1. image-2025-01-27-22-56-47-834.png
          56 kB
          Jian Li
        2. OTA-861_y_y_2.txt
          21 kB
          Jian Li
        3. OTA-861_y_y.txt
          18 kB
          Jian Li
        4. Cluster Settings · Details · Red Hat OpenShift.pdf
          161 kB
          Jian Li
        5. image-2025-02-18-12-51-01-941.png
          161 kB
          Jian Li

              Unassigned Unassigned
              rhn-support-jianl Jian Li
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: