Uploaded image for project: 'OpenShift Service Mesh'
  1. OpenShift Service Mesh
  2. OSSM-4223

MTT: verify flaky result in MustGather test

XMLWordPrintable

      We need to investigate to avoid flakiness in the test run for Mustgather test case in MTT, fails the first run sometimes and then in the reruns succeed:

      github.com/maistra/maistra-test-tool/pkg/tests/ossm.TestMustGather: 2 runs, 1 failures
      github.com/maistra/maistra-test-tool/pkg/tests/ossm.TestMustGather/resource_for_namespaces_exist: 2 runs, 1 failures
      
      
      === Failed
      === FAIL: pkg/tests/ossm TestMustGather/resource_for_namespaces_exist (47.39s)
          smcp_must_gather_test.go:120:    
          smcp_must_gather_test.go:120: STEP 1: verify that resources for namespaces are created including bookinfo and istio-system folders
          smcp_must_gather_test.go:153:    SUCCESS: /tmp/must-gather-2509115266/**/namespaces/istio-system/debug-syncz.json exists
          smcp_must_gather_test.go:153:    SUCCESS: /tmp/must-gather-2509115266/**/namespaces/istio-system/istio-system.yaml exists
          smcp_must_gather_test.go:153:    SUCCESS: /tmp/must-gather-2509115266/**/namespaces/bookinfo/bookinfo.yaml exists
          smcp_must_gather_test.go:153:    SUCCESS: /tmp/must-gather-2509115266/**/namespaces/openshift-operators/openshift-operators.yaml exists
          smcp_must_gather_test.go:153:    FATAL: Command failed: find /tmp/must-gather-2509115266/**/namespaces/*/rbac.authorization.k8s.io/rolebindings/istiod-clusterrole-basic-istio-system.yaml
              find: ‘/tmp/must-gather-2509115266/**/namespaces/*/rbac.authorization.k8s.io/rolebindings/istiod-clusterrole-basic-istio-system.yaml’: No such file or directory
              error: exit status 1
          subtest.go:23: 
          subtest.go:25: Subtest failed in 0.01s (excluding cleanup)
          test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4
          test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230620191806/v2.4/failures-must-gather/20230620192737-TestMustGather-resource_for_namespaces_exist
      
      === FAIL: pkg/tests/ossm TestMustGather (193.60s)
          smcp_must_gather_test.go:36: This test verifies must-gather log collection
          smcp_must_gather_test.go:43:    
          smcp_must_gather_test.go:43: STEP 1: Apply default SMCP and SMMR manifests
          smcp_must_gather_test.go:43:    Wait for condition Ready on smcp istio-system/basic...
          smcp_must_gather_test.go:43:    SUCCESS: Condition Ready met by smcp istio-system/basic
          smcp_must_gather_test.go:45:    
          smcp_must_gather_test.go:45: STEP 2: Deploy bookinfo in bookinfo ns
          smcp_must_gather_test.go:46:    Install app "bookinfo" in namespace "bookinfo"
          smcp_must_gather_test.go:46:    Create Bookinfo Gateway
          smcp_must_gather_test.go:46:    Create Bookinfo Destination Rules (all)
          smcp_must_gather_test.go:46:    Create Bookinfo Deployments
          smcp_must_gather_test.go:46:    Wait for app bookinfo/bookinfo to be ready
          smcp_must_gather_test.go:51:    
          smcp_must_gather_test.go:51: STEP 3: Capture must-gather using image registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 without namespace flag
          smcp_must_gather_test.go:52:    SUCCESS: Must gather completed successfully
          test.go:77: 
          test.go:79: Test failed in 131.01s (excluding cleanup)
          test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4
          test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230620191806/v2.4/failures-must-gather/20230620192825-TestMustGather
          smcp_must_gather_test.go:39: 
          smcp_must_gather_test.go:39: Performing cleanup
          smcp_must_gather_test.go:40:    Deleting namespaces: [bookinfo]
          smcp_must_gather_test.go:40:    Creating namespaces: [bookinfo]
          smcp_must_gather_test.go:39: Cleanup completed in 15.17s
      

            frherrer@redhat.com Francisco Herrera Lira
            frherrer@redhat.com Francisco Herrera Lira
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: