Uploaded image for project: 'OCP Technical Release Team'
  1. OCP Technical Release Team
  2. TRT-2538

Aggregator Passes When All Conformance Runs Timeout

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Found a case where tests ran extra long time (regression that got reverted) but we saw gcp-ovn-rt-upgrade-4.22-minor-release-openshift-release-analysis-aggregator indicate is passed. The issue is that the failing junits were never recorded due to the timeout.  We also no longer fail on timeout since we would often timeout on a post test gather step and negate the passing run.

       

      When looking at the individual job run we can see that Risk Analysis flagged it for Incomplete Tests.  We could consider collecting the Risk Analysis artifacts along with the Junit and check for this issue in more than X (3?) runs and fail.

              Unassigned Unassigned
              rh-ee-fbabcock Forrest Babcock
              None
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: