Uploaded image for project: 'Subscription Watch'
  1. Subscription Watch
  2. SWATCH-4230

Stabilize or Retire Flaky Test: test_validate_tally_for_physical_satellite_server

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • None
    • swatch-tally
    • 5
    • False
    • Hide

      None

      Show
      None
    • False
    • subs-swatch-thunder

      Evaluate and fix or retire the unreliable test_validate_tally_for_physical_satellite_server test to maintain trustworthy code quality checks.

      Based on table RHSM Subscriptions flaky tests

      Test: test_validate_tally_for_physical_satellite_server

       

      Currently the test is passing at a lower than acceptable rate. In order to maintain coverage we want to: 

      1. Determine the value the test is currently giving us. 
        1. If the test is not giving use value:
          1. Remove the test 
          2. Documented this test's lack of value in the comments of this card
      1. Does a lower environment have all the capabilities to run this test without affecting the value it brings?
        1. If the test can be a component test:
          1. Create the needed component tests to replace the test 
          2. Ensure the test plan for the Service has the new test(s) added
      1. If the test should remain:
        1. Determine if the test should be multiple tests 
          1. Fix the test

      Acceptance Criteria 

      The test has been evaluated, stabilized and runs in the proper environment. 

              Unassigned Unassigned
              rh-ee-erthomps Eric Thompson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: