Uploaded image for project: 'OpenShift GitOps'
  1. OpenShift GitOps
  2. GITOPS-2788

Get all Kuttl tests to pass in GitOps Operator OpenShift CI

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • None
    • Testing
    • None
    • GITOPS Sprint 235, GITOPS Sprint 236

      Story (Required)

      As a QE trying to stabilize openshift CI I want to reduce the number of flaky tests.

      Background (Required)

      There are some Kuttl tests that exhibit flaky behavior. Currently, there is no retry __ feature in kuttl for a failed test due to which running the whole suite becomes inevitable.

      Out of scope

      • Reducing the time taken for test execution 
      • Fixing tests that are failing even with maximum timeout 

      Approach (Required)

      • Go through frequently failing tests ( Tool that's currently keeping track of failed tests)
      • Debug the cause for flaky behavior 

      Dependencies

      N/A

      Acceptance Criteria (Mandatory)

      • The root cause for the flaky tests have been identified and fixed
      • Openshift CI is stable 

      INVEST Checklist

      Dependencies identified

      Blockers noted and expected delivery timelines set

      Design is implementable

      Acceptance criteria agreed upon

      Story estimated

      Legend

      Unknown

      Verified

      Unsatisfied

      Done Checklist

      • Code is completed, reviewed and checked in
      • Test automation have been delivered and running cleanly in continuous integration environment
      • Continuous Delivery pipeline(s) is able to proceed with new code included
      • Acceptance criteria are met

              rhn-support-vab Varsha B
              rhn-support-vab Varsha B
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: