Uploaded image for project: 'OPCT - OpenShift Provider Compatibility Tool'
  1. OPCT - OpenShift Provider Compatibility Tool
  2. OPCT-93

[opct][bug] Normally skipped tests are reporting as failures

    XMLWordPrintable

Details

    • Bug
    • Resolution: Not a Bug
    • Normal
    • None
    • None
    • None

    Description

      While reviewing a user's certification archive, it was noticed that skipped tests are reporting as failures. These should not be included in failure count and are increasing noise. This is in regards to provider cert case 03314948.

      Snippet:

      Failed tests:
      [sig-builds][Feature:Builds] custom build with buildah  being created from new-build should complete build with custom builder image [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
      [sig-imageregistry][Feature:Image] oc tag should change image reference for internal images [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
      [sig-imageregistry][Serial][Suite:openshift/registry/serial] Image signature workflow can push a signed image to openshift registry and verify it [Skipped:Disconnected] [Suite:openshift/conformance/serial]
      [sig-builds][Feature:Builds] oc new-app  should succeed with an imagestream [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
      [sig-builds][Feature:Builds][timing] capture build stages and durations  should record build stages and durations for docker [Skipped:Disconnected] [Suite:openshift/conformance/parallel]
      [sig-auth][Feature:UserAPI] users can manipulate groups [Suite:openshift/conformance/parallel]
      

      Attachments

        Activity

          People

            rhn-support-rbost Robert Bost
            rhn-support-rbost Robert Bost
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty