Uploaded image for project: 'OpenShift API for Data Protection'
  1. OpenShift API for Data Protection
  2. OADP-260

Measure useful metrics of the upstream OADP CI results.

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Won't Do
    • Icon: Undefined Undefined
    • None
    • None
    • ci
    • None
    • 0
    • 0
    • 0
    • Untriaged
    • None

      Upstream OpenShift Prow CI can be a great system, but we need to better understand how well it's working to provide meaningful feedback to developers. Measuring various aspects of upstream CI should help us understand how meaningful the CI results truly are.

          1.
          		 Ensure the measurements are accurate via rigourous unit tests. Sub-task Closed Undefined Hiteshwari Patel
          2.
          		 Measure global pass, fail, flake, aborted rates. Sub-task Closed Undefined Hiteshwari Patel
          3.
          		 Measure pass, fail, flake, aborted rates by OpenShift Version Sub-task Closed Undefined Hiteshwari Patel
          4.
          		 Measure pass, fail, flake, aborted rates by Cloud type Sub-task Closed Undefined Hiteshwari Patel
          5.
          		 Measure the pass, fail, flake rate of each e2e individual test Sub-task Closed Undefined Hiteshwari Patel
          6.
          		 Measure pass, fail, flake, aborted rates by Storage type? Sub-task Closed Undefined Hiteshwari Patel
          7.
          		 Measure pass, fail, flake, aborted rates by Pull Request Sub-task Closed Undefined Hiteshwari Patel
          8.
          		 Deliniate the grafana "failure" status in at least two ways. Sub-task Closed Undefined Unassigned

              hitpatel@redhat.com Hiteshwari Patel
              wnstb Wes Hayutin
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: