Uploaded image for project: 'OCP Technical Release Team'
  1. OCP Technical Release Team
  2. TRT-1072

component readiness: tests present in historical and missing in sample should be failures

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Minor Minor
    • None
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • None
    • None
    • None

      This may take phasing in over time, but we accidentally lost some storage tests. I see this as a fairly low priority

       

      Two benefits:

      • people can't just nerf tests instead of fixing them
      • when a test gets renamed, forces them to  update the ci-test-mapping

       

      We would need to implement StaffEngineerApprovedObsolete in test mapping (column is there but unused) so we can customize this behavior per test. 

       

      We also need to deal with the problem in 4.13 where some operator state change tests showed up in non-upgrades (that's the reason many squares are dull green in the 4.13->4.14 comparison)

       

              Unassigned Unassigned
              deads@redhat.com David Eads
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: