Uploaded image for project: 'Subscription Watch'
  1. Subscription Watch
  2. SWATCH-3284

Evaluate test failures blocking prod release

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Blocker Blocker
    • None
    • None
    • None
    • None
    • 5
    • False
    • Hide

      None

      Show
      None
    • True

      There are currently several test failures that need to be assessed/evaluated to determine if we can release to prod or not.

      https://ibutsu.insights.corp.redhat.com/project/3915c900-85fc-1222-833c-10d51af56f2e/runs/819b9287-cb7e-4d21-bbfb-f4c2c0909eb0#classify-failures 

      test_check_blockers_for_release 
      test_hourly_tally_properly_updates_past_measurements[ansible-aap-managed] 
      test_metrics_rounding[ansible-aap-managed] 
      test_validate_payg_multiple_metric_data[OpenShift-dedicated-metrics] 
      test_hypervisor_check_guest_mapping_update
      test_validate_cores_capacity_daily_on_openshift 
      test_add_sku_with_expiry_date_in_past rhsm_subscriptions    
      test_billing_category_tally[ansible-aap-managed] rhsm_subscriptions

       

      Acceptance Criteria:

      • Investigate each of the failures
      • Recommend whether we should release regardless of the failure or not
      • If the test failure shouldn't be release-blocking, mark it as skipped/disabled
      • If the test failure should block the release, create a Bug Jira card of type blocker and raise it in the slack channel for immediate action

              kflahert@redhat.com Kevin Flaherty
              lburnett0 Lindsey Burnett
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: