Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-32814

[2238218] VirtHandlerRESTErrorsHigh alert in firing state during ocp upgrade z stream 4.12.5 > 4.12.6

XMLWordPrintable

    • CNV I/U Operators Sprint 243, CNV I/U Operators Sprint 244, CNV I/U Operators Sprint 245, CNV I/U Operators Sprint 246, CNV I/U Operators Sprint 247, CNV I/U Operators Sprint 248, CNV I/U Operators Sprint 249, CNV I/U Operators Sprint 250, CNV I/U Operators Sprint 251
    • Medium
    • No

      Description of problem:
      During ocp upgrade v4.12.5 to 4.12.6 (cnv: v4.12.5-50), noticed alert 'VirtHandlerRESTErrorsHigh' in firing state.

      Version-Release number of selected component (if applicable):

      How reproducible: 1 of multiple attempts

      Steps to Reproduce:
      1.upgrade ocp z streams 4.12.5 > 4.12.6
      2.Check alerts fired during cnv upgrade

      Actual results:

      logs:
      [{'labels':

      {'alertname': 'VirtHandlerRESTErrorsHigh', 'kubernetes_operator_component': 'kubevirt', 'kubernetes_operator_part_of': 'kubevirt', 'severity': 'warning'}

      , 'annotations':

      {'runbook_url': 'https://kubevirt.io/monitoring/runbooks/VirtHandlerRESTErrorsHigh', 'summary': 'More than 5% of the rest calls failed in virt-handler for the last hour'}

      , 'state': 'firing', 'activeAt': '2023-09-14T12:02:04.531593741Z', 'value': '6.1842357154408945e-02'}

      Expected results:
      no alerts should fire during ocp upgrade process, we are trying to capture all the alerts that are fired during upgrades and reduce the noise generated.

      Additional info:
      must-gather log attached

            jvilaca@redhat.com João Vilaça
            rh-ee-ahafe Ahmad Hafi
            Ahmad Hafi Ahmad Hafi
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved:

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 1 hour
                1h