-
Bug
-
Resolution: Unresolved
-
Undefined
-
None
-
CNV v4.15.z, CNV v4.14.z, CNV v4.12.z, CNV v4.13.z
-
None
-
Quality / Stability / Reliability
-
0.42
-
False
-
-
False
-
None
-
-
CNV QE DevOps Sprint 285
-
None
Summary
CNV 4.14 Konflux-built HCO bundle has an incomplete test-images-nvrs CSV annotation: it includes ssp and tekton test images but omits hyperconverged-cluster-operator-test. The HCO test image is also not built/published for v4-14. As a result, HCO tier1 tests fail at the "Setup HCO tests" step.
Comparison: 4.16 (working) vs 4.14 (broken)
| Aspect | 4.16 (infd-vrf-416t0) | 4.14 (c01-lbednar) |
|---|---|---|
| test-images-nvrs includes HCO test | Yes | No |
| HCO test image in registry | Yes (digest in annotation) | No |
| HCO tier1 tests | Can run | Fail at setup |
test-images-nvrs Annotation
4.16 (complete): ssp, tekton, common-instancetypes, hyperconverged-cluster-operator-test
4.14 (incomplete): ssp, tekton only. Missing: hyperconverged-cluster-operator-test
(Note: common-instancetypes was added in 4.15 - its absence in 4.14 is expected.)
Cluster Details
4.16 reference: infd-vrf-416t0, CSV v4.16.32, IIB 1114259, bundle build-system: konflux
4.14 broken: c01-lbednar, CSV v4.14.17, IIB 1113344, bundle build-system: konflux
Bundle sources:
- v4-16: https://gitlab.cee.redhat.com/openshift-virtualization/konflux-builds/v4-16/hco-bundle-registry
- v4-14: https://gitlab.cee.redhat.com/openshift-virtualization/konflux-builds/v4-14/hco-bundle-registry
Root Cause
The Konflux pipeline that builds the HCO bundle for v4-14 either:
- Does not build the hyperconverged-cluster-operator-test image for v4-14, or
- Builds it but does not add it to the CSV test-images-nvrs annotation during bundle assembly
The component is defined in Konflux tenant config; the bug is in the build/publish pipeline.
Impact
- HCO tier1 tests fail at "Setup HCO tests"
- tests::get_test_image_nvr returns empty
- No workaround possible with current approach (image does not exist in registry)
Retrospective: Alternative Approach (pre CNV-73322)
Before CNV-73322 (Feb 2026), HCO tests used a different flow that did not depend on test-images-nvrs:
- Test image: quay.io/kubevirt/hyperconverged-cluster-functest (upstream)
- Version from HCO operator image upstream-version label, or hardcoded (e.g. 1.10.8 for 4.14)
- Image URL: quay.io/kubevirt/hyperconverged-cluster-functest:1.10.8-unstable
- This image exists and has tags 1.10.0, 1.10.8-unstable, etc.
Workaround option: Revert to or add fallback to upstream image when test-images-nvrs is empty for 4.14.
References
- QE automation: contra/cnv-qe-automation - tests/tier1/hco/setup.sh, tests/funcs.sh
- Related: CNV-73322 (Konflux test image resolution)
- is triggered by
-
CNV-81500 HCO tests fail: git/jq missing in test container (test-hco-cnv-4.16 #303)
-
- Closed
-