Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-52670

alert "VirtApiRESTErrorsHigh" fires on healthy clutser

XMLWordPrintable

    • 0.42
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • ---
    • ---
    • None

      Description of problem:

      alert "VirtApiRESTErrorsHigh" fire's while its not expected to be fired on a healthy cluster

      Version-Release number of selected component (if applicable):

      cnv v4.17.2

      How reproducible:

      it fires in all last test-pytest-cnv-4.17-observability-ocs lane (last 10 runs)https://main-jenkins-csb-cnvqe.apps.ocp-c1.prod.psi.redhat.com/job/test-pytest-cnv-4.17-observability-ocs/

       

       

      Steps to Reproduce:

      1.deploy a cluster 
      2.run following lane https://main-jenkins-csb-cnvqe.apps.ocp-c1.prod.psi.redhat.com/job/test-pytest-cnv-4.17-observability-ocs/ 3.
      

      Actual results:

      AssertionError: Alerts should not be fired on healthy cluster.
       {'VirtApiRESTErrorsHigh': [{'labels': {'alertname': 'VirtApiRESTErrorsHigh', 'kubernetes_operator_component': 'kubevirt', 'kubernetes_operator_part_of': 'kubevirt', 'operator_health_impact': 'warning', 'severity': 'warning'}, 'annotations': {'runbook_url': 'https://github.com/openshift/runbooks/blob/master/alerts/openshift-virtualization-operator/VirtApiRESTErrorsHigh.md', 'summary': 'More than 5% of the rest calls failed in virt-api for the last hour'}, 'state': 'firing', 'activeAt': '2024-11-26T16:01:52.686476251Z', 'value': '5.2863436123348026e-02'}]}

      Expected results:

      alert is not expected to fire's

      Additional info:

      additional log file will be attached

              sradco Shirly Radco
              rh-ee-ahafe Ahmad Hafi
              Krzysztof Majcher Krzysztof Majcher
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: