Uploaded image for project: 'OCP Technical Release Team'
  1. OCP Technical Release Team
  2. TRT-2394

Openshift-tests are not treating multiple junit for the same test from OTE correctly

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • 4.21
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      There was a bug in upstream test where the same test appeared twice in list tests. Normally both tests pass and we had no issue with that. In this case, one test failed while the other succeeded. The upstream bug was already being taken care of.

      But this does reveal an issue with how OTE is treating multiple tests with the same name. When there are multiple test results for the same test (e.g. one success one failure) from OTE, openshift-tests is not treating it as flake, while prow is. This resulted in no failing junits showing for a failing job. See below thread for details

      See thread here: https://redhat-internal.slack.com/archives/C02K89U2EV8/p1761091006815509?thread_ts=1761076190.716189&cid=C02K89U2EV8

      Suggestions from stbenjam is to error out when we see two tests for the same name.

              kenzhang@redhat.com Ken Zhang
              kenzhang@redhat.com Ken Zhang
              None
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: