Description of problem:
During cnv upgrade v4.11.2-8 to 4.12.0-760 (ocp version being 4.12.0-rc.4), noticed KubevirtHyperconvergedClusterOperatorCRModification alert in firing state.

Version-Release number of selected component (if applicable):
v4.11.2-8 to 4.12.0-760 (ocp version being 4.12.0-rc.4)

How reproducible:
Saw in first attempt.

Steps to Reproduce:
1. Check alerts fired during cnv upgrade
2.
3.

Actual results:
{'labels':

{'alertname': 'KubevirtHyperconvergedClusterOperatorCRModification', 'component_name': 'prometheusrule/kubevirt-hyperconverged-prometheus-rule', 'kubernetes_operator_component': 'hyperconverged-cluster-operator', 'kubernetes_operator_part_of': 'kubevirt', 'severity': 'warning'}

, 'annotations':

{'description': 'Out-of-band modification for prometheusrule/kubevirt-hyperconverged-prometheus-rule.', 'runbook_url': 'https://kubevirt.io/monitoring/runbooks/KubevirtHyperconvergedClusterOperatorCRModification', 'summary': '1 out-of-band CR modifications were detected in the last 10 minutes.'}

, 'state': 'firing', 'activeAt': '2022-12-14T15:53:46.416956243Z', 'value': '1e+00'}

Expected results:
https://issues.redhat.com/browse/CNV-14405:
Based on the above, we are trying to capture all the alerts that are fired during upgrades and reduce the noise generated.

Additional info: