Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-66219

VCSP/OPCT: kubernetes/conformance suite fails on OCP 4.20+ - suite removed from openshift-tests

XMLWordPrintable

    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • Proposed
    • OpenShift SPLAT - Sprint 280
    • 1
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

         Starting with OCP 4.20, the kubernetes/conformance test suite is no longer available in the openshift-tests binary, causing the OPCT
        kube-conformance plugin (10-openshift-kube-conformance) to fail when attempting to run Kubernetes conformance tests. This prevents provider
        certification workflows from completing successfully on OCP 4.20+ clusters.  
      
      The root cause is that the kubernetes/conformance suite was removed from openshift-tests in OCP 4.20. The conformance tests are now only available
         through the OTE (OpenShift Tests Extended) k8s-tests-ext binary embedded in the hyperkube image.   

      Version-Release number of selected component (if applicable):

      Affected Versions:
        - OpenShift Container Platform: 4.20+, 4.21+
        - OPCT: v0.6.0 and earlier
        - openshift-tests-plugin: All versions prior to fix  
      Working Versions:
        - OpenShift Container Platform: 4.19 and earlier (suite still available)

      How reproducible:

            100% reproducible on OCP 4.20+ clusters
      

      Steps to Reproduce:

        1. Deploy an OCP 4.20 or 4.21 cluster (any provider)
        2. Install OPCT CLI (v0.6.0 or earlier)
        3. Run OPCT with the kube-conformance plugin:
        opct run --watch
        4. Observe the plugin 10-openshift-kube-conformance execution
      

      Actual results:

        - Plugin 10-openshift-kube-conformance fails with error:
        suite "kubernetes/conformance" not found
        - OPCT certification workflow fails
        - Subsequent dependent plugins (20-openshift-conformance-validated, 80-openshift-tests-replay) continue running despite prerequisite failure,
        wasting execution time
        - Provider certification cannot be completed for OCP 4.20+ clusters
      

      Expected results:

        - Kubernetes conformance tests should execute successfully using the k8s-tests-ext binary from the hyperkube image
        - Tests should be extracted dynamically at runtime
        - Backward compatibility with OCP 4.19 and earlier should be maintained
        - Failed plugins should stop execution of dependent plugins to save time
      

      Additional info:

        Impact:
        - Blocks provider VCSP validation for OCP 4.20+ releases
        - Affects all cloud providers and platforms applying for VCSP Program or self-validation (Oracle offerings)
        - Critical for Partners validating on OCP 4.20 
      

              rhn-support-mrbraga Marco Braga
              rhn-support-mrbraga Marco Braga
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: