Uploaded image for project: 'OpenShift Service Mesh'
  1. OpenShift Service Mesh
  2. OSSM-6310

Fix flaky IOR integration tests

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • None
    • Customer Impact, Maistra
    • None
    • False
    • None
    • False

      Our integration tests for IOR often fails, due to timeout of the validation webhook. Since our CI infrastructure has limited resources, we should fix that timeout.

      2024-04-15T13:48:35.272014Z	info	tf	=== BEGIN: Test Run: 'servicemesh_managingroutes' ===
      === RUN   TestManagingGateways
      2024-04-15T13:48:35.272233Z	info	tf	=== BEGIN: Test: 'servicemesh_managingroutes[TestManagingGateways]' ===
      2024-04-15T13:48:35.272305Z	info	tf	=== BEGIN: Create namespace gateway ===
      2024-04-15T13:48:35.276398Z	info	tf	=== SUCCEEDED: Create namespace gateway in 4.091357ms ===
      2024-04-15T13:48:35.276413Z	info	tf	=== BEGIN: Create namespace a ===
      2024-04-15T13:48:35.281321Z	info	tf	=== SUCCEEDED: Create namespace a in 4.904408ms ===
      2024-04-15T13:48:35.281348Z	info	tf	=== BEGIN: Create namespace b ===
      2024-04-15T13:48:35.286478Z	info	tf	=== SUCCEEDED: Create namespace b in 5.127272ms ===
      2024-04-15T13:48:35.286495Z	info	tf	=== BEGIN: Create namespace c ===
      2024-04-15T13:48:35.291341Z	info	tf	=== SUCCEEDED: Create namespace c in 4.844335ms ===
      === RUN   TestManagingGateways/RouteCreation
      2024-04-15T13:48:37.597770Z	info	tf	=== BEGIN: Test: 'servicemesh_managingroutes[TestManagingGateways/RouteCreation]' ===
      === NAME  TestManagingGateways
          main_test.go:249: retry.UntilSuccessOrFail: timeout while waiting after 1 attempts (last error: failed applying YAML files [/logs/artifacts/servicemesh-managingroutes-6a52/TestManagingGateways/_test_context/Gateway.2695016431.yaml] to ns gateway-2-70408 in cluster cluster-0: error when creating "/logs/artifacts/servicemesh-managingroutes-6a52/TestManagingGateways/_test_context/Gateway.2695016431.yaml": Internal error occurred: failed calling webhook "validation.istio.io": failed to call webhook: Post "https://istiod-istio-system.istio-system-1-26408.svc:443/validate?timeout=10s": context deadline exceeded: )
      2024-04-15T13:48:47.613923Z	info	tf	=== DONE (passed):  Test: 'servicemesh_managingroutes[TestManagingGateways/RouteCreation] (10.016150827s)' ===
      === NAME  TestManagingGateways/RouteCreation
          main_test.go:224: retry.UntilSuccessOrFail: timeout while waiting after 7 attempts (last error: found unexpected routes 0)
      === RUN   TestManagingGateways/RouteChange
      2024-04-15T13:49:17.624505Z	info	tf	=== BEGIN: Test: 'servicemesh_managingroutes[TestManagingGateways/RouteChange]' ===
      2024-04-15T13:49:18.697825Z	info	tf	=== DONE (passed):  Test: 'servicemesh_managingroutes[TestManagingGateways/RouteChange] (1.07331847s)' ===
          main_test.go:224: retry.UntilSuccessOrFail: timeout while waiting after 7 attempts (last error: found unexpected routes 0)
      === RUN   TestManagingGateways/RouteLabelUpdate
      2024-04-15T13:49:48.711575Z	info	tf	=== BEGIN: Test: 'servicemesh_managingroutes[TestManagingGateways/RouteLabelUpdate]' ===
      2024-04-15T13:49:49.259084Z	info	tf	=== DONE (passed):  Test: 'servicemesh_managingroutes[TestManagingGateways/RouteLabelUpdate] (547.509662ms)' ===
          main_test.go:224: retry.UntilSuccessOrFail: timeout while waiting after 7 attempts (last error: found unexpected routes 0)
      2024-04-15T13:50:19.271074Z	info	tf	=== DONE (failed):  Test: 'servicemesh_managingroutes[TestManagingGateways] (1m43.998835572s)' ===
      2024-04-15T13:50:19.271129Z	error	tf	=== Dumping Istio Deployment State for TestManagingGateways...
      2024-04-15T13:50:19.271154Z	error	tf	=== Dumping Namespace istio-system-1-26408 State for TestManagingGateways...
      2024-04-15T13:50:19.399204Z	info	tf	istioctl ([x internal-debug --all clusterz --istioNamespace istio-system-1-26408]): completed after 0.1278s
      2024-04-15T13:50:19.414162Z	error	tf	=== Dumping Namespace c-5-87899 State for TestManagingGateways...
      2024-04-15T13:50:19.414194Z	error	tf	=== Dumping Namespace b-4-62486 State for TestManagingGateways...
      2024-04-15T13:50:19.414169Z	error	tf	=== Dumping Namespace a-3-47719 State for TestManagingGateways...
      2024-04-15T13:50:19.414181Z	error	tf	=== Dumping Namespace gateway-2-70408 State for TestManagingGateways...
      2024-04-15T13:50:19.439442Z	info	tf	istioctl ([x internal-debug --all configz --istioNamespace istio-system-1-26408]): completed after 0.1680s
      2024-04-15T13:50:19.481468Z	info	tf	istioctl ([x internal-debug --all mcsz --istioNamespace istio-system-1-26408]): completed after 0.2101s
      --- FAIL: TestManagingGateways (107.21s)
          --- FAIL: TestManagingGateways/RouteCreation (40.03s)
          --- FAIL: TestManagingGateways/RouteChange (31.09s)
          --- FAIL: TestManagingGateways/RouteLabelUpdate (30.56s)
      FAIL
      

            rh-ee-yannliu Yann Liu
            jewertow@redhat.com Jacek Ewertowski
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: