CNV Perf & Scale team maintains Opensearch and Grafana index used to show regression progress and results. VME Perf & Scale QE will need to on board new tests and create dashboards which show results including monitoring metric profiles used for existing workloads. This epic is about onboarding those new workloads and getting results stored, and viewable via grafana.

User Story 1: Data Collection for Regression Metrics

As a performance engineer, I want scripts that collect key regression metrics so that they can be indexed and visualized.

• Task: Define key metrics for 4.22 regression (e.g., review kubevirt metrics profile already in use and define which additional env and versioning metadata is needed.
• Task: Write scripts that pull metrics from post workload executions.
• Task: Store collected data in a structured format (e.g., JSON).

User Story 2: Indexing Regression Data

As a performance engineer, I want regression data indexed in ElasticSearch/Opensearch so it’s searchable and ready for dashboards.

• Task: Investigate existing index and metric patterns for CNV regression data
• Task: Onboard index mapping to ElasticSearch (or OpenSearch) schemas to accommodate the regression metrics.
• Task: Create scripts that enable collected data into ElasticSearch.
• Task: Create scripts that enable artifacts & related data into S3.

User Story 3: Grafana Dashboards for Regression Results

As a performance engineer, I want dashboards in Grafana to visualize regression results easily for the 4.22 release.

• Task: Design Grafana dashboard layouts (e.g., panels for each metric).
• Task: Review dashboards with stakeholders for feedback and refinement.