Uploaded image for project: 'OpenShift Specialist Platform Team'
  1. OpenShift Specialist Platform Team
  2. SPLAT-1667

[platform-external][doc] Create guide to run dedicated tests exercising CCM

    • 5

      {}USER STORY:{}

      As a Partner engineer exploring OpenShift integrations with platform type External, I would like to execute specific E2E tests, instead of whole suite, so I can focus in identifying provider's specific issues.

      {}DESCRIPTION:{}

      Partners, like Oracle, had been using test tooling to validate OpenShift installation in their infrastructure[2]. The tools used to schedule conformance suites in the process of validation is openshift-tests and opct (backed by Sonobuoy and openshift-tests).

      The tooling orchestrates e2e tests defined for each component, and community. There is no dedicated suite to exercise CCM tests in generic way, required by Platform External. Although the existing kubernetes suite (non-conformance) there are some tests which is exercising some CCM actions, like create Load Balancer, etc.

      The goal of this Epic is to document how to schedule and steps to analyse the results when scheduling such tests. You can see an exploration of e2e tests using sonobuoy tool in Spike SPLAT-1224

      Goal:

      • Document* the steps to execute filtered e2e tests from conformance suite into the target cluster installed with platform type External
        •  
      • The steps must covered using opct/sonobuoy (explored in SPLAT-1224 ) and openshift-tests utility (creating custom test file, used by partner[1]) when isolating flakes in their platform

      *The documentation must be under the Provider Infra Onboarding Guide, test section: https://docs.providers.openshift.org/platform-external/e2e-testing/#opct-utility 

       

      {}Required:{}

      • Documentation created and merged in the infrastructure On boarding guide website
      •  

      {}Nice to have:{}

      • Action items of next steps, such as answering those questions:
        • do we need to create one suite in openshift-tests to schedule platform external or CCM specific tests?
        • Is there bugs in the existing tests that can be addressed o/k?

      {}ACCEPTANCE CRITERIA:{}

      • PR merged documenting steps to use OPCT and openshift-tests
      • The document must cover, at minimum, examples of tests exercising CCM. Eg described in the spike SPLAT-1224

      {}ENGINEERING DETAILS:{}

              Unassigned Unassigned
              rhn-support-mrbraga Marco Braga
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: