Uploaded image for project: 'Subscription Watch'
  1. Subscription Watch
  2. SWATCH-3974

Evaluate post-stage test failures to prepare for prod release

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Blocker Blocker
    • None
    • None
    • None
    • 8
    • False
    • Hide

      None

      Show
      None
    • False
    • subs-swatch-thunder
    • Swatch Thunder Sprint 2

      Determine if it's safe to do a prod release based on this https://reportportal-smqe.apps.dno.ocp-hub.prod.psi.redhat.com/ui/#subscription_watch/launches/all/347065?item0Params=filter.eq.hasStats%3Dtrue%26filter.eq.hasChildren%3Dfalse%26filter.in.type%3DSTEP%26filter.in.status%3DFAILED.

      I've prepopulated this card with subtasks based on those failures, filtered down to just the ones that are pertinent to what subs-swatch-thunder works on (thanks rhn-sqe-tmcknigh for helping with this!). I assigned priority of each subtask based on the "importance" level that was assigned to the test in report portal as a starting place.

      Acceptance Criteria

      • Investigate each of the failing tests
      • For each one, determine if the failure is a symptom of a flaky test, or something that needs to be addressed before we can release to production.
        • Use the "Convert to Task" on the subtasks in Jira at the conclusion of the investigation of that failing test. Update the priority accordingly. "Blocker" priority should be used to indicate "we should NOT release to production if this test is failing".
      • Blocker test failures should be investigated further and resolved as part of this card
      • If one of the subtasks that are pre-populated with "Blocker" priority isn't actually a blocker for release, please bump the priority down.
      • Cards for failing tests that were deemed to not block release should be put in the Backlog.

              rhn-sqe-tmcknigh Trayvon McKnight
              lburnett0 Lindsey Burnett
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: