Uploaded image for project: 'Subscription Watch'
  1. Subscription Watch
  2. SWATCH-4517

Fix flaky IQE tally tests - migrate to java

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Normal Normal
    • 2026-02-10 - API
    • None
    • None
    • None
    • 3
    • False
    • Hide

      None

      Show
      None
    • False
    • subs-swatch-thunder
    • Swatch Thunder Sprint 8

      Two iqe tally tests failed when multiple pipelines were running at a similar time.  The coverage for these flaky tests should be captured in the java component tests and removed from IQE.

      https://ci.ext.devshift.net/job/RedHatInsights-rhsm-subscriptions-pr-check/13866/

      tests.component.swatch_tally.test_tally_multiple_products_same_instance.test_tally_multiple_products_same_instance_conflicting_events                       
      >               assert tally_total == value, (
                          f"Total tally value for \{metric} is \{tally_total} when it should be \{value}"
                      )
      E               AssertionError: Total tally value for vCPUs is 0 when it should be 40
      E               assert 0 == 40
      

       
       
      https://ci.ext.devshift.net/job/RedHatInsights-rhsm-subscriptions-pr-check/13864/

       tests.component.swatch_tally.test_tally_multiple_products_same_instance.test_tally_multiple_products_same_instance
                      tally_total = sum(record["value"] for record in tally.data)
      >               assert tally_total == value, (
                          f"Total tally value for {metric} is {tally_total} when it should be {value}"
                      )
      E               AssertionError: Total tally value for vCPUs is 0 when it should be 40
      E               assert 0 == 40
      

      Resources:

      • Logs are attached for each of these runs.
      • zipped artifacts are attached
      • A screenshot with the start times.

      Acceptance Criteria:

      • The two tests are removed from IQE
      • The test coverage is captured in the java component tests

        1. Screenshot From 2026-01-08 15-14-34.png
          398 kB
          Vanessa Busch
        2. subscriptions-pr-check-13864.txt
          2.74 MB
          Vanessa Busch
        3. subscriptions-pr-check-13866.txt
          14.96 MB
          Vanessa Busch

              rh-ee-liwalker Lisa Walker
              buschv Vanessa Busch
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: