Uploaded image for project: 'Subscription Watch'
  1. Subscription Watch
  2. SWATCH-3896

Find a way to set tags on test reports uploaded through new component testing framework

XMLWordPrintable

    • Icon: Spike Spike
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • None
    • None
    • 5
    • True
    • Hide

      None

      Show
      None
    • True
    • subs-swatch-lightning

      Both Ibutsu and Report Portal accept XML Surefire reports but don't show run tags and test markers.

      It's possible to manipulate them once the report is uploaded by leveraging the APIs (see https://ibutsu-api.insights.corp.redhat.com/api/ui and Report Portal, the Ibutsu OpenAPI spec is wrong in some definitions).

      But the ideal solution would be to set tags and markers directly into the XML file. Some JUnit plugin could do the job.

      Note that the XML set failed tests as error instead of failure, fix this.

      If no solution is found to set them in XML in a native way, one approach that can be adopted is setting metadata in XML by parsing test files with a simple script and update in batch the report.

      Acceptance Criteria:

      • Test reports uploaded through the new testing framework are tagged properly with component under test and additional markers for each test involved.
      • the solution found is maintainable and it's as native as possible (hence no strange scripting is required)

              Unassigned Unassigned
              rh-ee-tlencion Tommaso Lencioni
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: