Uploaded image for project: 'OpenShift Over the Air'
  1. OpenShift Over the Air
  2. OTA-362

CI: fail update suite if any ClusterOperator go Available=False

    XMLWordPrintable

Details

    • Story
    • Resolution: Done
    • Major
    • None
    • None
    • None
    • OTA 243, OTA 244, OTA 245

    Description

      These are alarming conditions which may frighten customers, and we don't want to see them in our own, controlled, repeatable update CI. This example job had logs like:

      Feb 18 21:11:25.799 E clusteroperator/openshift-apiserver changed Degraded to True: APIServerDeployment_UnavailablePod: APIServerDeploymentDegraded: 1 of 3 requested instances are unavailable for apiserver.openshift-apiserver ()

      And the job failed, but none of the failures were "something made openshift-apiserver mad enough to go Degraded".

      Attachments

        Issue Links

          blocks

          Spike - Represents a research-related task. OTA-980 Is the Failing=True status condition is a good indicator for admins?

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • To Do
          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. OTA-701 Communicate available and degraded condition definition to teams

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed
          is depended on by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. TRT-1576 CI: fail update suite if any ClusterOperator go Available=False outside of updates

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • In Progress
          is related to

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-20056 Single short-lived operand blip shouldn't cause authentication operator Available=False

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • New

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-20062 kube-storage-version-migrator goes Available=False with reason=KubeStorageVersionMigrator_Deploying during updates

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • New

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-23746 openshift-apiserver ClusterOperator should not blip Available=False on brief missing HTTP content-type

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • New

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. TRT-1575 CI: fail update suite if any ClusterOperator go Degraded=True

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Refinement

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-20061 control-plane-machine-set goes Available=False with UnavailableReplicas during updates

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • ASSIGNED

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-9108 openshift-tests-upgrade.[bz-Machine Config Operator] clusteroperator/machine-config should not change condition/Available

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Verified

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-23744 operator-lifecycle-manager-packageserver ClusterOperator should not blip Available=False on 4.14 to 4.15 updates

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Verified

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-24041 Console blips Available=False with RouteHealth_FailedGet and such

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Verified

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-24228 machine-config ClusterOperator should not blip Available=False on brief missing HTTP content-type

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Verified

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-32089 Authentication blips Available=False with WellKnown_NotReady

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Verified

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. TRT-1235 Work with Service Delivery On Reducing Problematic Alerts

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-825 Available=False with no reason

          • Normal - To be worked after urgent and high priorities are resolved. This term is chosen when the severity of an issue is relatively close to the level of effort to fix it. The existence of an easily implemented workaround can also lead to this priority level instead of a higher priority.
          • Closed

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-22364 ControllerCertificate struct validation failed during upgrade from 4.14 to 4.15

          • Normal - To be worked after urgent and high priorities are resolved. This term is chosen when the severity of an issue is relatively close to the level of effort to fix it. The existence of an easily implemented workaround can also lead to this priority level instead of a higher priority.
          • Closed

          Bug - A problem that impairs or prevents the functions of the product. OCPBUGS-23745 monitoring ClusterOperator should not blip Available=False on quick etcd leader changes

          • Normal - To be worked after urgent and high priorities are resolved. This term is chosen when the severity of an issue is relatively close to the level of effort to fix it. The existence of an easily implemented workaround can also lead to this priority level instead of a higher priority.
          • Closed
          links to

          GitHub openshift/origin#27231: OTA-362: pkg/monitortests/clusterversionoperator: Fatal unless Available=False in allow-list

          Web Link origin#25920

          Activity

            People

              trking W. Trevor King
              trking W. Trevor King
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: