Description of problem: During cnv upgrade v4.11.2-8 to 4.12.0-760 (ocp version being 4.12.0-rc.4), noticed SSPCommonTemplatesModificationReverted alert in firing state.

Version-Release number of selected component (if applicable):
v4.11.2-8 to 4.12.0-760 (ocp version being 4.12.0-rc.4)

How reproducible:
Saw in first attempt.

Steps to Reproduce:
1. Check alerts fired during cnv upgrade
2.
3.

Actual results:
{'labels':

{'alertname': 'SSPCommonTemplatesModificationReverted', 'kubernetes_operator_component': 'ssp-operator', 'kubernetes_operator_part_of': 'kubevirt', 'severity': 'warning'}

, 'annotations':

{'runbook_url': 'https://kubevirt.io/monitoring/runbooks/SSPCommonTemplatesModificationReverted', 'summary': 'Common Templates manual modifications were reverted by the operator'}

, 'state': 'firing', 'activeAt': '2022-12-14T15:56:18.045242874Z', 'value': '1.1584271111111113e+02'}

Expected results:
https://issues.redhat.com/browse/CNV-14405:
Based on the above, we are trying to capture all the alerts that are fired during upgrades and reduce the noise generated.

Additional info: