Uploaded image for project: 'OpenShift SDN'
  1. OpenShift SDN
  2. SDN-2995

console operator degraded from "All is Well" to "RouteHealthDegraded"

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Normal
    • None
    • None
    • None
    • 0
    • 0

    Description

      job link

      must-gather

      e2e log has this complaint:

      {  2 events happened too frequently
      
      event happened 27 times, something is wrong: ns/openshift-console-operator deployment/console-operator - reason/OperatorStatusChanged Status for clusteroperator/console changed: Degraded message changed from "All is well" to "RouteHealthDegraded: failed to GET route (https://console-openshift-console.apps.ci-op-dky02rqk-ce95c.aws-2.ci.openshift.org): Get \"https://console-openshift-console.apps.ci-op-dky02rqk-ce95c.aws-2.ci.openshift.org\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)",Available changed from True to False ("RouteHealthAvailable: failed to GET route (https://console-openshift-console.apps.ci-op-dky02rqk-ce95c.aws-2.ci.openshift.org): Get \"https://console-openshift-console.apps.ci-op-dky02rqk-ce95c.aws-2.ci.openshift.org\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)")
      event happened 25 times, something is wrong: ns/openshift-console-operator deployment/console-operator - reason/OperatorStatusChanged Status for clusteroperator/console changed: Degraded message changed from "RouteHealthDegraded: failed to GET route (https://console-openshift-console.apps.ci-op-dky02rqk-ce95c.aws-2.ci.openshift.org): Get \"https://console-openshift-console.apps.ci-op-dky02rqk-ce95c.aws-2.ci.openshift.org\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" to "All is well",Available changed from False to True ("All is well")}
      

      so, essentially the console clusteroperator was not happy for some period of time and reported it too many times (I think 20 is the limit before we get a
      test failure). But, at the end of the job when some artifacts are collected, the clusteroperator output shows that it's not degraded (FWIW).

      NAME                                       VERSION                              AVAILABLE   PROGRESSING   DEGRADED   SINCE   MESSAGE
      authentication                             4.11.0-0.nightly-2022-04-20-130429   True        False         False      53m     
      baremetal                                  4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      cloud-controller-manager                   4.11.0-0.nightly-2022-04-20-130429   True        False         False      80m     
      cloud-credential                           4.11.0-0.nightly-2022-04-20-130429   True        False         False      80m     
      cluster-autoscaler                         4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      config-operator                            4.11.0-0.nightly-2022-04-20-130429   True        False         False      71m     
      console                                    4.11.0-0.nightly-2022-04-20-130429   True        False         False      14s     
      csi-snapshot-controller                    4.11.0-0.nightly-2022-04-20-130429   True        False         False      71m     
      dns                                        4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      etcd                                       4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      image-registry                             4.11.0-0.nightly-2022-04-20-130429   True        False         False      62m     
      ingress                                    4.11.0-0.nightly-2022-04-20-130429   True        False         False      62m     
      insights                                   4.11.0-0.nightly-2022-04-20-130429   True        False         False      64m     
      kube-apiserver                             4.11.0-0.nightly-2022-04-20-130429   True        False         False      56m     
      kube-controller-manager                    4.11.0-0.nightly-2022-04-20-130429   True        False         False      68m     
      kube-scheduler                             4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      kube-storage-version-migrator              4.11.0-0.nightly-2022-04-20-130429   True        False         False      71m     
      machine-api                                4.11.0-0.nightly-2022-04-20-130429   True        False         False      66m     
      machine-approver                           4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      machine-config                             4.11.0-0.nightly-2022-04-20-130429   True        False         False      70m     
      marketplace                                4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      monitoring                                 4.11.0-0.nightly-2022-04-20-130429   True        False         False      54m     
      network                                    4.11.0-0.nightly-2022-04-20-130429   True        False         False      77m     
      node-tuning                                4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      openshift-apiserver                        4.11.0-0.nightly-2022-04-20-130429   True        False         False      54m     
      openshift-controller-manager               4.11.0-0.nightly-2022-04-20-130429   True        False         False      63m     
      openshift-samples                          4.11.0-0.nightly-2022-04-20-130429   True        False         False      68m     
      operator-lifecycle-manager                 4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      operator-lifecycle-manager-catalog         4.11.0-0.nightly-2022-04-20-130429   True        False         False      69m     
      operator-lifecycle-manager-packageserver   4.11.0-0.nightly-2022-04-20-130429   True        False         False      67m     
      service-ca                                 4.11.0-0.nightly-2022-04-20-130429   True        False         False      71m     
      storage                                    4.11.0-0.nightly-2022-04-20-130429   True        False         False      71m     
      ​
      

      link to this job's testgrid for reference.

       

      Attachments

        Issue Links

          Activity

            People

              ffernand@redhat.com Flavio Fernandes (Inactive)
              jluhrsen Jamo Luhrsen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 3 hours
                  3h