-
Task
-
Resolution: Unresolved
-
Undefined
-
None
-
None
-
5
-
False
-
-
False
-
subs-swatch-thunder
-
-
Evaluate and fix or retire the unreliable test_validate_is_marketplace_fact_for_aws test to ensure accurate AWS Marketplace usage validation.
Based on table RHSM Subscriptions flaky tests
Test: test_validate_is_marketplace_fact_for_aws
Currently the test is passing at a lower than acceptable rate. In order to maintain coverage we want to:
- Determine the value the test is currently giving us.
- If the test is not giving use value:
- Remove the test
- Documented this test's lack of value in the comments of this card
- If the test is not giving use value:
- Does a lower environment have all the capabilities to run this test without affecting the value it brings?
- If the test can be a component test:
- Create the needed component tests to replace the test
- Ensure the test plan for the Service has the new test(s) added
- If the test can be a component test:
- If the test should remain:
- Determine if the test should be multiple tests
- Fix the test
- Determine if the test should be multiple tests
Acceptance Criteria
The test has been evaluated, stabilized and runs in the proper environment.
- clones
-
SWATCH-4247 Stabilize or Retire Flaky Test: Hypervisor Check with No Guests
-
- Backlog
-
- is cloned by
-
SWATCH-4250 Stabilize or Retire Flaky Test: Subscription Data Consistency (Table vs. Graph)
-
- Backlog
-