[sgao@fedora Downloads]$ ./openshift-provider-cert-linux-amd64 report 202307111003_sonobuoy_15814032-25b5-47e0-be7a-2c7b254077e0.tar.gz INFO[2023-07-11T08:25:29-07:00] Processing Plugin 05-openshift-cluster-upgrade... INFO[2023-07-11T08:25:29-07:00] Ignoring Plugin 05-openshift-cluster-upgrade INFO[2023-07-11T08:25:29-07:00] Processing Plugin 10-openshift-kube-conformance... INFO[2023-07-11T08:25:29-07:00] Processing Plugin 20-openshift-conformance-validated... INFO[2023-07-11T08:25:29-07:00] Processing Plugin 99-openshift-artifacts-collector... INFO[2023-07-11T08:25:29-07:00] Ignoring Plugin 99-openshift-artifacts-collector WARN[2023-07-11T08:25:31-07:00] Ignoring to populate source 'baseline'. Missing or invalid baseline artifact (-b): > OpenShift Provider Certification Summary < Kubernetes API Server version : v1.26.5+7d22122 OpenShift Container Platform version : 4.13.4 - Cluster Update Progressing : False - Cluster Target Version : Cluster version is 4.13.4 OCP Infrastructure: - PlatformType : VSphere - Name : sgao-vsan-hbwfc - Topology : HighlyAvailable - ControlPlaneTopology : HighlyAvailable - API Server URL : https://api.sgao-vsan.qe.devcluster.openshift.com:6443 - API Server URL (internal) : https://api-int.sgao-vsan.qe.devcluster.openshift.com:6443 Plugins summary by name: Status [Total/Passed/Failed/Skipped] (timeout) - 10-openshift-kube-conformance : failed [706/695/11/0] (0) - 20-openshift-conformance-validated : failed [3911/1725/51/2135] (0) Health summary: [A=True/P=True/D=True] - Cluster Operators : [33/0/0] - Node health : 6/6 (100%) - Pods health : 281/281 (100%) > Processed Summary < Total tests by conformance suites: - kubernetes/conformance: 364 - openshift/conformance: 3559 Result Summary by conformance plugins: - 10-openshift-kube-conformance: - Status: failed - Total: 706 - Passed: 695 - Failed: 11 - Timeout: 0 - Skipped: 0 - Failed (without filters) : 11 - Failed (Filter SuiteOnly): 0 - Failed (Filter CI Flakes): 0 - Status After Filters : pass - 20-openshift-conformance-validated: - Status: failed - Total: 3911 - Passed: 1725 - Failed: 51 - Timeout: 0 - Skipped: 2135 - Failed (without filters) : 51 - Failed (Filter SuiteOnly): 32 - Failed (Filter CI Flakes): 12 - Status After Filters : failed Result details by conformance plugins: => 10-openshift-kube-conformance: (0 failures, 0 flakes) --> Failed tests to Review (without flakes) - Immediate action: --> Failed flake tests - Statistic from OpenShift CI => 20-openshift-conformance-validated: (32 failures, 20 flakes) --> Failed tests to Review (without flakes) - Immediate action: [sig-arch] Managed cluster should ensure control plane pods do not run in best-effort QoS [Suite:openshift/conformance/parallel] [sig-arch] Managed cluster should set requests but not limits [Suite:openshift/conformance/parallel] [sig-cli] oc basics can get version information from API [Suite:openshift/conformance/parallel] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Inline-volume (default fs)] volumes should allow exec of files on the volume [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Inline-volume (default fs)] volumes should store data [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Inline-volume (ext4)] volumes should allow exec of files on the volume [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Inline-volume (ext4)] volumes should store data [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Pre-provisioned PV (default fs)] volumes should allow exec of files on the volume [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Pre-provisioned PV (default fs)] volumes should store data [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Pre-provisioned PV (ext4)] volumes should allow exec of files on the volume [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Pre-provisioned PV (ext4)] volumes should store data [Suite:openshift/conformance/parallel] [Suite:k8s] [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly] [Suite:openshift/conformance/parallel] [Suite:k8s] --> Failed flake tests - Statistic from OpenShift CI Flakes Perc TestName 3 0.435% [sig-api-machinery][Feature:APIServer] anonymous browsers should get a 403 from / [Suite:openshift/conformance/parallel] 688 99.855% [sig-arch] Managed cluster should ensure platform components have system-* priority class associated [Suite:openshift/conformance/parallel] -- -- [sig-arch][Late] clients should not use APIs that are removed in upcoming releases [apigroup:apiserver.openshift.io] [Suite:openshift/conformance/parallel] -- -- [sig-auth][Feature:OAuthServer] OAuth server has the correct token and certificate fallback semantics [apigroup:user.openshift.io] [Suite:openshift/conformance/parallel] -- -- [sig-auth][Feature:OAuthServer] well-known endpoint should be reachable [apigroup:route.openshift.io] [Suite:openshift/conformance/parallel] -- -- [sig-auth][Feature:OpenShiftAuthorization][Serial] authorization TestAuthorizationResourceAccessReview should succeed [apigroup:authorization.openshift.io] [Suite:openshift/conformance/serial] -- -- [sig-auth][Feature:UserAPI] users can manipulate groups [apigroup:user.openshift.io][apigroup:authorization.openshift.io][apigroup:project.openshift.io] [Suite:openshift/conformance/parallel] -- -- [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) CustomResourceDefinition Should scale with a CRD targetRef [Suite:openshift/conformance/parallel] [Suite:k8s] -- -- [sig-builds][Feature:Builds] oc new-app should succeed with an imagestream [apigroup:build.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel] -- -- [sig-cli] oc builds new-build [apigroup:build.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel] -- -- [sig-instrumentation] Prometheus [apigroup:image.openshift.io] when installed on the cluster shouldn't report any alerts in firing state apart from Watchdog and AlertmanagerReceiversNotConfigured [Early][apigroup:config.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel] 515 57.800% [sig-instrumentation][Late] Alerts shouldn't report any unexpected alerts in firing or pending state [Suite:openshift/conformance/parallel] -- -- [sig-instrumentation][Late] OpenShift alerting rules [apigroup:image.openshift.io] should have a runbook_url annotation if the alert is critical [Skipped:Disconnected] [Suite:openshift/conformance/parallel] -- -- [sig-instrumentation][Late] OpenShift alerting rules [apigroup:image.openshift.io] should have description and summary annotations [Skipped:Disconnected] [Suite:openshift/conformance/parallel] -- -- [sig-network] services when running openshift ipv4 cluster ensures external ip policy is configured correctly on the cluster [apigroup:config.openshift.io] [Serial] [Suite:openshift/conformance/serial] -- -- [sig-network][Feature:tap] should create a pod with a tap interface [apigroup:k8s.cni.cncf.io] [Suite:openshift/conformance/parallel] 47 6.821% [sig-node] Pods Extended Pod Container lifecycle should not create extra sandbox if all containers are done [Suite:openshift/conformance/parallel] [Suite:k8s] -- -- [sig-node][apigroup:config.openshift.io] CPU Partitioning cluster infrastructure should be configured correctly [Suite:openshift/conformance/parallel] -- -- [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly] [Suite:openshift/conformance/parallel] [Suite:k8s] -- -- [sig-storage] In-tree Volumes [Driver: vsphere] [Testpattern: Pre-provisioned PV (block volmode)] volumes should store data [Suite:openshift/conformance/parallel] [Suite:k8s]