Starting with OCP 4.20, the kubernetes/conformance test suite was broken running by OPCT, see bug OCPBUGS-66219.
   with the fix, the conformance workflow starting running but the amount of tests are inconsistent with what used to be.

As you can see in the data below from different CI jobs, the test list isn not calculated correctly:
https://prow.ci.openshift.org/?job=periodic-ci-redhat-openshift-ecosystem-opct-*
https://prow.ci.openshift.org/?job=*opct-external*


*Tests on versions prior 4.20*

--
**4.18-platform-external-vsphere**
- 10-openshift-kube-conformance: Total: 402
- 20-openshift-conformance-validated: Total: 3914

https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/periodic-ci-redhat-openshift-ecosystem-opct-main-4.18-platform-external-vsphere/2028772729326407680/artifacts/platform-external-vsphere/opct-conformance-test-results/artifacts/log-results.txt

--
**4.19-platform-external-vsphere**:
- 10-openshift-kube-conformance: Total: 412
- 20-openshift-conformance-validated  Total: 4077

https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/periodic-ci-redhat-openshift-ecosystem-opct-main-4.19-platform-external-vsphere/2028410338113753088/artifacts/platform-external-vsphere/opct-conformance-test-results/artifacts/log-results.txt

---
Tests on starting on 4.20:

4.20-opct-external-aws-ccm:
- Failed https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-main-nightly-4.20-opct-external-aws-ccm/2027897242865635328

--
main-4.20-platform-external-vsphere:
- 10-openshift-kube-conformance: Total: 2972
- 20-openshift-conformance-validated Total: 4163

https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/test-platform-results/logs/periodic-ci-redhat-openshift-ecosystem-opct-main-4.20-platform-external-vsphere/2022974301082226688/artifacts/platform-external-vsphere/opct-conformance-test-results/artifacts/log-results.txt

--
4.21-opct-external-aws-ccm:
- 20-openshift-conformance-validated: Total: 742
- 10-openshift-kube-conformance: Total: 3223

https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-main-nightly-4.21-opct-external-aws-ccm/2025360613919690752: 

--
4.22-opct-external-aws-ccm : 
- 10-openshift-kube-conformance: Total: 3225
- 20-openshift-conformance-validated: Total: 755

https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-release-main-nightly-4.22-opct-external-aws-ccm/2027897333462601728

---


Additionally, when looking at e2e of platform external (similar opct-e2e-external), which runs a subset of opct workflow (20-openshift-conformance-validated), the suite openshift/conformance/parallel, it shows the test count of:
https://prow.ci.openshift.org/?job=*openshift-release-*e2e-external*

- 4.20-e2e-external-aws: total 5623 (total)
- 4.20-e2e-external-aws-ccm: 5623 (total)
- 4.21-e2e-external-vsphere-ccm: 5919 (total)
- nightly-4.21-e2e-external-aws-ccm: 5963 (total)
- nightly-4.22-e2e-external-vsphere-ccm: 6026 (total) 3882 (passed)
- nightly-4.22-e2e-external-aws-ccm: 6071 (total) 3881 (passed)

Affected Versions:
  - OpenShift Container Platform: 4.20+
  - OPCT: v0.6.0 and earlier
  - openshift-tests-plugin: All versions prior to fix  

Working Versions:
  - OpenShift Container Platform: 4.19 and earlier (suite still available)

      100% reproducible on OCP 4.20+ clusters

  1. Deploy an OCP 4.20+ (any provider)
  2. Install OPCT CLI (v0.6.0 or earlier)
  3. Run OPCT with the kube-conformance plugin:
  opct run --watch
  4. Observe the plugin 10-openshift-kube-conformance and 20-openshift-conformance-validated: execution

  - Steps 10-openshift-kube-conformance and 20-openshift-conformance-validated runs but generate a wrong number of tests, meaning it could be running more tests than expected, that's why this bug is reported, if this is expected now we need to udnerstand:
- why 10-openshift-kube-conformance missmatch upstream conformance test count? https://github.com/cncf/k8s-conformance/blob/master/v1.34/openshift/e2e.log#L6C3-L6C24
- why 20-openshift-conformance-validated: is lower than expected? It used to be 3k+ tests based in the history

  Impact:
  - Blocks provider VCSP validation for OCP 4.20+ releases
  - Affects all cloud providers and platforms applying for VCSP Program or self-validation (Oracle offerings)
  - Critical for Partners validating on OCP 4.20 

Context: https://redhat-internal.slack.com/archives/C03UZKBRHT5/p1764004100459919