-
Bug
-
Resolution: Unresolved
-
Critical
-
None
-
4.20, 4.21
-
None
-
False
-
-
None
-
None
-
None
-
None
-
None
-
Proposed
-
OpenShift SPLAT - Sprint 280
-
1
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Description of problem:
Starting with OCP 4.20, the kubernetes/conformance test suite is no longer available in the openshift-tests binary, causing the OPCT kube-conformance plugin (10-openshift-kube-conformance) to fail when attempting to run Kubernetes conformance tests. This prevents provider certification workflows from completing successfully on OCP 4.20+ clusters. The root cause is that the kubernetes/conformance suite was removed from openshift-tests in OCP 4.20. The conformance tests are now only available through the OTE (OpenShift Tests Extended) k8s-tests-ext binary embedded in the hyperkube image.
Version-Release number of selected component (if applicable):
Affected Versions: - OpenShift Container Platform: 4.20+, 4.21+ - OPCT: v0.6.0 and earlier - openshift-tests-plugin: All versions prior to fix
Working Versions: - OpenShift Container Platform: 4.19 and earlier (suite still available)
How reproducible:
100% reproducible on OCP 4.20+ clusters
Steps to Reproduce:
1. Deploy an OCP 4.20 or 4.21 cluster (any provider) 2. Install OPCT CLI (v0.6.0 or earlier) 3. Run OPCT with the kube-conformance plugin: opct run --watch 4. Observe the plugin 10-openshift-kube-conformance execution
Actual results:
- Plugin 10-openshift-kube-conformance fails with error: suite "kubernetes/conformance" not found - OPCT certification workflow fails - Subsequent dependent plugins (20-openshift-conformance-validated, 80-openshift-tests-replay) continue running despite prerequisite failure, wasting execution time - Provider certification cannot be completed for OCP 4.20+ clusters
Expected results:
- Kubernetes conformance tests should execute successfully using the k8s-tests-ext binary from the hyperkube image - Tests should be extracted dynamically at runtime - Backward compatibility with OCP 4.19 and earlier should be maintained - Failed plugins should stop execution of dependent plugins to save time
Additional info:
Impact: - Blocks provider VCSP validation for OCP 4.20+ releases - Affects all cloud providers and platforms applying for VCSP Program or self-validation (Oracle offerings) - Critical for Partners validating on OCP 4.20