-
Task
-
Resolution: Done
-
Normal
-
None
-
None
-
Quality / Stability / Reliability
-
3
-
False
-
-
False
-
Not Selected
-
-
-
Installer Train 37 - 4
-
Moderate
-
None
The installer automation test case "RHACM4K-38953: Validate components post upgrade" compares components before and after an upgrade to make sure there are no changes. This check is not reliable and often fails if there are expected changes. It should be enhanced to work more reliable and to give better results.
For example, this fails but seems to be due to new components being added.
TASK [upgrade-tests : RHACM4K-38953: Validate components post upgrade] *********
task path: /home/jenkins/workspace/qe-acm-automation-poc/install_upgrade_tests/acm/roles/upgrade-tests/tasks/main.yml:1
Wednesday 14 January 2026 23:40:57 +0000 (0:00:00.059) 0:00:10.717 *****
fatal: [localhost]: FAILED! => {
"assertion": "mch_pre_comps_inactive | trim | from_yaml | list | length == mch_post_comps_inactive | length",
"changed": false,
"evaluated_to": false,
"msg": "MCE active comps post-upgrade: ['local-cluster', 'assisted-service', 'cluster-lifecycle', 'cluster-manager', 'discovery', 'hive', 'server-foundation', 'cluster-proxy-addon', 'hypershift-local-hosting', 'hypershift', 'managedserviceaccount', 'console-mce'] MCE active comps pre-upgrade: ['local-cluster', 'assisted-service', 'cluster-lifecycle', 'cluster-manager', 'discovery', 'hive', 'server-foundation', 'cluster-proxy-addon', 'hypershift-local-hosting', 'hypershift', 'managedserviceaccount', 'console-mce'] \n MCE inactive comps post-upgrade: ['cluster-api', 'cluster-api-provider-aws', 'cluster-api-provider-metal3', 'cluster-api-provider-openshift-assisted', 'image-based-install-operator'] MCE inactive comps pre-upgrade: ['cluster-api', 'cluster-api-provider-aws', 'cluster-api-provider-metal3', 'cluster-api-provider-openshift-assisted', 'image-based-install-operator'] \n MCH active comps post-upgrade: ['app-lifecycle', 'cluster-lifecycle', 'cluster-permission', 'console', 'grc', 'insights', 'multicluster-engine', 'multicluster-observability', 'search', 'submariner-addon', 'volsync', 'cluster-backup', 'siteconfig', 'cnv-mtv-integrations-preview'] MCH active comps pre-upgrade: ['app-lifecycle', 'cluster-lifecycle', 'cluster-permission', 'console', 'grc', 'insights', 'multicluster-engine', 'multicluster-observability', 'search', 'submariner-addon', 'volsync', 'cluster-backup', 'siteconfig', 'cnv-mtv-integrations-preview'] \n MCH inactive comps post-upgrade: ['fine-grained-rbac-preview'] MCH inactive comps pre-upgrade: ['edge-manager-preview', 'fine-grained-rbac-preview', 'siteconfig', 'cnv-mtv-integrations-preview'] \n"
}
Sample Jenkins job: https://jenkins-csb-rhacm-tests.dno.corp.redhat.com/job/qe-acm-automation-poc/job/install_upgrade_tests/281/