Uploaded image for project: 'OPCT - OpenShift Provider Compatibility Tool'
  1. OPCT - OpenShift Provider Compatibility Tool
  2. OPCT-91

[opct][plugin-openshift-tests][bug] Total counter is incorrect - backport 4.11

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • None
    • None
    • None

    Description

      Running the OPCT with the latest version (v0.1.0) on OCP 4.11.0, the openshift-tests is reporting an incorrect counter for the "total" field.

      In the example below, after the 1127th test, the total follows the same counter of executed. I also would assume that the total is incorrect before that point as the test continues the execution increases both counters.

       

      openshift-tests output format: [failed/executed/total]

      started: (0/1126/1127) "[sig-storage] PersistentVolumes-expansion  loopback local block volume should support online expansion on node [Suite:openshift/conformance/parallel] [Suite:k8s]"
      
      passed: (38s) 2022-08-09T17:12:21 "[sig-storage] In-tree Volumes [Driver: nfs] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with mount options [Suite:openshift/conformance/parallel] [Suite:k8s]"
      
      started: (0/1127/1127) "[sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support two pods which have the same volume definition [Suite:openshift/conformance/parallel] [Suite:k8s]"
      
      passed: (6.6s) 2022-08-09T17:12:21 "[sig-storage] Downward API volume should provide container's memory request [NodeConformance] [Conformance] [Suite:openshift/conformance/parallel/minimal] [Suite:k8s]"
      
      started: (0/1128/1128) "[sig-storage] In-tree Volumes [Driver: cinder] [Testpattern: Dynamic PV (immediate binding)] topology should fail to schedule a pod which has topologies that conflict with AllowedTopologies [Suite:openshift/conformance/parallel] [Suite:k8s]"
      
      skip [k8s.io/kubernetes@v1.24.0/test/e2e/storage/framework/testsuite.go:116]: Driver local doesn't support GenericEphemeralVolume -- skipping
      Ginkgo exit error 3: exit with code 3
      
      skipped: (400ms) 2022-08-09T17:12:21 "[sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: tmpfs] [Testpattern: Generic Ephemeral-volume (block volmode) (late-binding)] ephemeral should support two pods which have the same volume definition [Suite:openshift/conformance/parallel] [Suite:k8s]"
      
      started: (0/1129/1129) "[sig-storage] In-tree Volumes [Driver: emptydir] [Testpattern: Dynamic PV (default fs)] capacity provides storage capacity information [Suite:openshift/conformance/parallel] [Suite:k8s]" 

       

      OPCT output format [executed/total (failed failures)]

      Tue, 09 Aug 2022 14:12:13 -03> Global Status: running
      JOB_NAME                         | STATUS     | RESULTS    | PROGRESS                  | MESSAGE                                           
      openshift-conformance-validated  | running    |            | 1112/1127 (0 failures)    | status=running                                    
      openshift-kube-conformance       | complete   |            | 352/352 (0 failures)      | waiting for post-processor...                     
      Tue, 09 Aug 2022 14:12:23 -03> Global Status: running
      JOB_NAME                         | STATUS     | RESULTS    | PROGRESS                  | MESSAGE                                           
      openshift-conformance-validated  | running    |            | 1120/1127 (0 failures)    | status=running                                    
      openshift-kube-conformance       | complete   |            | 352/352 (0 failures)      | waiting for post-processor...                     
      Tue, 09 Aug 2022 14:12:33 -03> Global Status: running
      JOB_NAME                         | STATUS     | RESULTS    | PROGRESS                  | MESSAGE                                           
      openshift-conformance-validated  | running    |            | 1139/1139 (0 failures)    | status=running                                    
      openshift-kube-conformance       | complete   |            | 352/352 (0 failures)      | waiting for post-processor...                     
      Tue, 09 Aug 2022 14:12:43 -03> Global Status: running
      JOB_NAME                         | STATUS     | RESULTS    | PROGRESS                  | MESSAGE                                           
      openshift-conformance-validated  | running    |            | 1185/1185 (0 failures)    | status=running                                    
      openshift-kube-conformance       | complete   |            | 352/352 (0 failures)      | waiting for post-processor...                     
      Tue, 09 Aug 2022 14:12:53 -03> Global Status: running
      JOB_NAME                         | STATUS     | RESULTS    | PROGRESS                  | MESSAGE                                           
      openshift-conformance-validated  | running    |            | 1188/1188 (0 failures)    | status=running                                    
      openshift-kube-conformance       | complete   |            | 352/352 (0 failures)      | waiting for post-processor...      

       

       

       

       

      Attachments

        Issue Links

          Activity

            People

              rhn-support-mrbraga Marco Braga
              rhn-support-mrbraga Marco Braga
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty