The goal of this task is to develop and implement a "Release Confidence Score" for our OSSM Operator.

This score will be generated by querying test data from Report Portal using its official MCP server (https://github.com/reportportal/reportportal-mcp-server). The resulting metric will provide a data-driven summary of test quality and results, which will help the team make informed go/no-go decisions for our final testing and release process.

Dependencies:

All test results from the different stages of the release process must be consistently and reliably pushed into Report Portal. Jira Epic: https://issues.redhat.com/browse/OSSM-4620

Acceptance Criteria:

• A clear definition of the "Release Confidence Score" is established (i.e., what metrics are included and how they are weighted).
• A connection to the Report Portal MCP server is successfully established.
• The MCP server is used to query and aggregate key test result data (e.g., pass/fail rates, new failures, flaky test counts) from all relevant release stages.
• A script, service, or agent is created to transform this aggregated data into the defined "Release Confidence Score".
• The final score is accessible to the team, for example, using devlake to aggregate the results