Uploaded image for project: 'OPCT - OpenShift Provider Compatibility Tool'
  1. OPCT - OpenShift Provider Compatibility Tool
  2. OPCT-195

[plugin][openshift-tests] What is the impact when running suites in serial mode?

    XMLWordPrintable

Details

    • Spike
    • Resolution: Won't Do
    • Critical
    • None
    • None
    • Plugins

    Description

      We need to evaluate whether there is any benefit to the results and validation environment when running the suites in serial mode.

      why? We are seeing a slightly high number of failures in 'know platforms' such as AWS, even checking the existing flakes. We need to check if the parallel is impacting the results.

      Goal:

      • Run OPCT on AWS (Platform=None) with default execution (parallel)
      • Run OPCT on AWS (Platform=None) with both suites (kubernetes/conformance and openshift/conformance) in serial mode

      Collect the results of both and measure the differences, focusing on:

      • failure ratio
      • plugin execution time and total execution time

      Attachments

        Activity

          People

            rhn-support-mrbraga Marco Braga
            rhn-support-mrbraga Marco Braga
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty