Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-72139

Propose moving test_csv_permissions_audit testcase to tier1

XMLWordPrintable

    • Quality / Stability / Reliability
    • 0.42
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • None

      tests/install_upgrade_operators/csv/csv_permissions_audit/test_csv_permissions_audit.py::
      test_compare_csv_permissions is failing quite often in all the versions as it is checking the hardcoded tests/install_upgrade_operators/csv/csv_permissions_audit/csv-permissions.yaml file, and requires a manual upgrade everytime it fails.
       
      During the discussion about the quarantine process (https://issues.redhat.com/browse/CNV-68870), it was concluded that this test should not be part of tier2 for several reasons:
       

      • Tier2 should be focused on e2e usecases and not configuration stuff.
      • The actual functionality that these permissions provide is fully tested by the full testsuite, which ensures that the required permissions are granted.
      • Tier1 includes the information to dinamically check the permissions that is built on run/compilation time.

      This test is quarantined until an agreement with devs is reached and therefore we can remove the test from the tier2 scope.
       
      The goal for this task is:

      • to reach this agreement with devs so a new task is prioritized in the tier1 tests backlog.
      • to completely remove the test from tier2 tests, instead of having it quarantined.

              rlobillo Ramón Lobillo
              rlobillo Ramón Lobillo
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: