Description:

In discussions, we agree that the team would start to upload all the XML files to Report Portal to track all the information needed at the moment, such as flaky results, most failed test cases, test suite duration, test case growth, etc.

This can be added to each testing job in Jenkins using a new script that allows us to upload the files. More information about how to upload files using a script is here: https://docs.engineering.redhat.com/pages/viewpage.action?pageId=239690733

It does not need to use any plugins. In the report portal API description page, you can see all the available methods to upload, etc., all the launches in the portal

https://reportportal-ossm.apps.dno.ocp-hub.prod.psi.redhat.com/ui/#api

Useful information:

A new instance of the report portal for the OSSM group has been created:

https://reportportal-ossm.apps.dno.ocp-hub.prod.psi.redhat.com/ui

Admin of the project: frherrer@redhat.com 

You need to request access to frherrer@redhat.com , Once you have access, the login information will be: username = roverUsername, password=pin+token

Data injection

The injection of the data to Report portal can be done using this tool: https://spaces.redhat.com/pages/viewpage.action?pageId=115488042&spaceKey=CentralCI&title=D%2BO%2BData%2BRouter 

Acceptance criteria:

We are able to track all the test results of the upstream, midstream, and downstream test runs in one place using Report Portal. This includes Kiali, Cypress, Sail, Istio, OSSM3 test runs

Why use Report Portal?

Polarion is the tool to report all the results under releases for downstream, but we need a way to track the test results in one place for also upstream and midstream. This includes test growth

Design of the project information:

This is going to be tracked here: https://docs.google.com/document/d/1M-NYw5YnAjcpmUWKCP47ldHHH68-GE1oshiAZZpyrhI/edit?tab=t.0