Uploaded image for project: 'Subscription Watch'
  1. Subscription Watch
  2. SWATCH-4248

Stabilize or Retire Flaky E2E Test: test_e2e_conduit_stage

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • None
    • swatch-tally
    • 5
    • False
    • Hide

      None

      Show
      None
    • False
    • subs-swatch-thunder

      Evaluate and fix or retire the highly unreliable End-to-End test test_e2e_conduit_stage to restore trust in core workflow verification.

      Based on table RHSM Subscriptions flaky tests

      Test: test_e2e_conduit_stage

      Currently the test is passing at a lower than acceptable rate. In order to maintain coverage we want to: 

      1. Determine the value the test is currently giving us. 
        1. If the test is not giving use value:
          1. Remove the test 
          2. Documented this test's lack of value in the comments of this card
      1. Does a lower environment have all the capabilities to run this test without affecting the value it brings?
        1. If the test can be a component test:
          1. Create the needed component tests to replace the test 
          2. Ensure the test plan for the Service has the new test(s) added
      1. If the test should remain:
        1. Determine if the test should be multiple tests 
          1. Fix the test

      Acceptance Criteria 

      1. The test has been evaluated, stabilized and runs in the proper environment. 

      2. Evaluate naming convention of "e2e," and if there's a better, more appropriate naming convention.

              Unassigned Unassigned
              rh-ee-erthomps Eric Thompson
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: