• Icon: Story Story
    • Resolution: Done
    • Icon: Major Major
    • None
    • None
    • None
    • None
    • 8
    • False
    • False
    • +
    • Undefined

      In conjunction with certifying OVN as a CNI plugin (OSSM-282), we should develop and document conformance tests

      This includes:

      • Policy requirements - a document list of the requirements/tests that are part of the conformance test.
        • member namespaces can talk to each other
        • member namespaces can talk to the control plane
        • namespaces outside of the mesh cannot talk to member namespaces by default
        • ingress gateways can be contacted by ingress controllers even if they're outside the mesh
        • kiali, prometheus, jaeger and grafana are accessible from outside the mesh
      • The test harness itself (A script in a Github repo that a partner can execute)
      • A method to analyze the results that produces a pass/fail (so that we don't have to review results, ideally provides feedback on any issues encountered).

      For the test suite, while Kubernetes E2E test suite is one possibility, it can be written in any format or framework. Likewise, there are no format restrictions on the output, though it should provide a clear pass/fail result.

       

      Can be incorporated into the main suite: https://redhat-connect.gitbook.io/openshift-badges/badges/container-network-interface-cni/workflow/running-the-cni-tests (instructions to run the test and revaluate the results).

      Page to review results of test results (add comment for Mesh test suite): 

      https://source.redhat.com/groups/public/epm/ecosystem_partner_management_wiki/openshift_cni_certification_results

       

            [OSSM-297] Service Mesh - CNI Conformance Test Suite

            Closing this for now, as partners are given access to our maistra-test tool to validate conformance. This may need to evolve as Service Mesh's test practices evolve. Issues running the test tool, or debugging results can be filed in OSSM as "Tickets" for engineering support.

            Jamie Longmuir added a comment - Closing this for now, as partners are given access to our maistra-test tool to validate conformance. This may need to evolve as Service Mesh's test practices evolve. Issues running the test tool, or debugging results can be filed in OSSM as "Tickets" for engineering support.

              Unassigned Unassigned
              jlongmui@redhat.com Jamie Longmuir
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

                Created:
                Updated:
                Resolved: