scripts/runtests.sh OSSM Operator version is 2.4.0 Output dir: /go/src/maistra-test-tool/tests/result-20230717063758 Executing tests against SMCP version 2.4 WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 68 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Resetting cluster by deleting namespaces used in the test suite Output dir: /go/src/maistra-test-tool/tests/result-20230717063758/v2.4 ====== Executing tests in group 'interop' against SMCP v2.4 test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestSMCPMultiple test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMCPMultiple (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/non-dependant 1.388s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestIstiodPodFailsAfterRestarts test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestIstiodPodFailsAfterRestarts (0.00s) === RUN TestDeployOnInfraNodes test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestDeployOnInfraNodes (0.00s) === RUN TestDiscoverySelectors test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestDiscoverySelectors (0.00s) === RUN TestInitContainerNotRemovedDuringInjection test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestInitContainerNotRemovedDuringInjection (0.00s) === RUN TestIOR test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestIOR (0.00s) === RUN TestOperatorCanUpdatePrometheusConfigMap test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOperatorCanUpdatePrometheusConfigMap (0.00s) === RUN TestRateLimiting test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestRateLimiting (0.00s) === RUN TestSMCPAddons test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMCPAddons (0.00s) === RUN TestSMCPAnnotations test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMCPAnnotations (0.00s) === RUN TestMustGather test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestMustGather (0.00s) === RUN TestTLSVersionSMCP smcp_tls_ssl_test.go:25: This test checks if the SMCP updated the tls.minProtocolVersion to TLSv1_0, TLSv1_1, and tls.maxProtocolVersion to TLSv1_3. smcp_tls_ssl_test.go:34: smcp_tls_ssl_test.go:34: STEP 1: Apply default SMCP and SMMR manifests smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestTLSVersionSMCP/minVersion_TLSv1_0 smcp_tls_ssl_test.go:37: smcp_tls_ssl_test.go:37: STEP 1: Update SMCP spec.security.controlPlane.tls.minProtocolVersion: TLSv1_0 smcp_tls_ssl_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:39: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 9.96s (excluding cleanup) --- PASS: TestTLSVersionSMCP/minVersion_TLSv1_0 (9.96s) === RUN TestTLSVersionSMCP/minVersion_TLSv1_1 smcp_tls_ssl_test.go:43: smcp_tls_ssl_test.go:43: STEP 1: Check to see if the SMCP minProtocolVersion is TLSv1_1 smcp_tls_ssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 9.93s (excluding cleanup) --- PASS: TestTLSVersionSMCP/minVersion_TLSv1_1 (9.93s) === RUN TestTLSVersionSMCP/maxVersion_TLSv1_3 smcp_tls_ssl_test.go:49: smcp_tls_ssl_test.go:49: STEP 1: Check to see if the SMCP maxProtocolVersion is TLSv1_3 smcp_tls_ssl_test.go:51: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:51: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 9.86s (excluding cleanup) --- PASS: TestTLSVersionSMCP/maxVersion_TLSv1_3 (9.86s) test.go:77: test.go:82: Test completed in 70.69s (excluding cleanup) smcp_tls_ssl_test.go:26: smcp_tls_ssl_test.go:26: Performing cleanup smcp_tls_ssl_test.go:31: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:31: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smcp_tls_ssl_test.go:26: Cleanup completed in 9.97s --- PASS: TestTLSVersionSMCP (80.66s) === RUN TestSMMRAutoCreationAndDeletion test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMMRAutoCreationAndDeletion (0.00s) === RUN TestSmoke smoke_test.go:46: Smoke Test for SMCP: deploy, upgrade, bookinfo and uninstall smoke_test.go:56: Deleting namespaces: [istio-system] smoke_test.go:56: Creating namespaces: [istio-system] === RUN TestSmoke/upgrade_v2.3_to_v2.4 smoke_test.go:59: This test checks whether SMCP becomes ready after it's upgraded from v2.3 to v2.4 and bookinfo is still working after the upgrade and also test a clean installation of the target SMCP smoke_test.go:65: smoke_test.go:65: STEP 1: Install SMCP v2.3 and verify it becomes ready smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:68: smoke_test.go:68: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:69: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:69: Create Bookinfo Gateway smoke_test.go:69: Create Bookinfo Destination Rules (all) smoke_test.go:69: Create Bookinfo Deployments smoke_test.go:69: Install app "sleep" in namespace "bookinfo" smoke_test.go:69: Wait for app bookinfo/bookinfo to be ready smoke_test.go:69: Wait for app bookinfo/sleep to be ready smoke_test.go:71: smoke_test.go:71: STEP 5: Check if bookinfo traffic flows through the Proxy smoke_test.go:138: SUCCESS: ProductPage returns 200 OK smoke_test.go:138: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:138: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:74: smoke_test.go:74: STEP 6: Upgrade SMCP from v2.3 to v2.4 smoke_test.go:187: smoke_test.go:187: STEP 7: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 8: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:77: smoke_test.go:77: STEP 9: Check if bookinfo productpage is running through the Proxy after the upgrade smoke_test.go:138: SUCCESS: ProductPage returns 200 OK smoke_test.go:138: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:138: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:80: smoke_test.go:80: STEP 10: Delete Bookinfo pods to force the update of the sidecar smoke_test.go:125: smoke_test.go:125: STEP 11: Verify if all the routes are created smoke_test.go:196: Related issue: https://issues.redhat.com/browse/OSSM-4069 smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: SUCCESS: Route kiali is created smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:128: smoke_test.go:128: STEP 12: Check if bookinfo traffic flows through the Proxy smoke_test.go:138: SUCCESS: ProductPage returns 200 OK smoke_test.go:138: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:138: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:131: smoke_test.go:131: STEP 13: verify proxy startup time. Expected to be less than 10 seconds smoke_test.go:132: Jira related: https://issues.redhat.com/browse/OSSM-3586 smoke_test.go:157: Extracting proxy startup time and last transition time for all the pods in the namespace subtest.go:23: subtest.go:28: Subtest completed in 105.04s (excluding cleanup) smoke_test.go:60: smoke_test.go:60: Performing cleanup smoke_test.go:61: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:62: Deleting namespaces: [istio-system] smoke_test.go:62: Creating namespaces: [istio-system] smoke_test.go:60: Cleanup completed in 29.93s --- PASS: TestSmoke/upgrade_v2.3_to_v2.4 (134.96s) === RUN TestSmoke/install_smcp_v2.4 smoke_test.go:87: This test checks whether SMCP v2.4 install the SMCP version smoke_test.go:92: smoke_test.go:92: STEP 1: Install SMCP v2.4 smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:95: smoke_test.go:95: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:96: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:96: Create Bookinfo Gateway smoke_test.go:96: Create Bookinfo Destination Rules (all) smoke_test.go:96: Create Bookinfo Deployments smoke_test.go:96: Install app "sleep" in namespace "bookinfo" smoke_test.go:96: Wait for app bookinfo/bookinfo to be ready smoke_test.go:96: Wait for app bookinfo/sleep to be ready smoke_test.go:125: smoke_test.go:125: STEP 5: Verify if all the routes are created smoke_test.go:196: Related issue: https://issues.redhat.com/browse/OSSM-4069 smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 1/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 2/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 3/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 4/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 5/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 6/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 7/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 8/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 9/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 10/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 11/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 12/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 13/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 14/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 15/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 16/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 17/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: FAILURE: Still waiting for route kiali to be created in namespace; expected to find the string 'kiali' in the output, but it wasn't found smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 18/60 failed. Retrying... smoke_test.go:198: SUCCESS: Route grafana is created smoke_test.go:198: SUCCESS: Route istio-ingressgateway is created smoke_test.go:198: SUCCESS: Route jaeger is created smoke_test.go:198: SUCCESS: Route kiali is created smoke_test.go:198: SUCCESS: Route prometheus is created smoke_test.go:197: --- Attempt 19/60 successful; total time: 19.29s smoke_test.go:128: smoke_test.go:128: STEP 6: Check if bookinfo traffic flows through the Proxy smoke_test.go:138: SUCCESS: ProductPage returns 200 OK smoke_test.go:138: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:138: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:131: smoke_test.go:131: STEP 7: verify proxy startup time. Expected to be less than 10 seconds smoke_test.go:132: Jira related: https://issues.redhat.com/browse/OSSM-3586 smoke_test.go:157: Extracting proxy startup time and last transition time for all the pods in the namespace subtest.go:23: subtest.go:28: Subtest completed in 48.43s (excluding cleanup) smoke_test.go:88: smoke_test.go:88: Performing cleanup smoke_test.go:89: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:88: Cleanup completed in 1.56s --- PASS: TestSmoke/install_smcp_v2.4 (49.99s) === RUN TestSmoke/delete_smcp_v2.4 smoke_test.go:102: This test checks whether SMCP v2.4 deletion deletes all the resources smoke_test.go:107: smoke_test.go:107: STEP 1: Delete SMCP and SMMR in namespace istio-system smoke_test.go:110: smoke_test.go:110: STEP 2: verify SMCP resources are deleted smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 1/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 2/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 3/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 4/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 5/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 6/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 7/60 failed. Retrying... smoke_test.go:112: SUCCESS: SMCP resources are deleted smoke_test.go:111: --- Attempt 8/60 successful; total time: 8.11s subtest.go:23: subtest.go:28: Subtest completed in 9.74s (excluding cleanup) smoke_test.go:103: smoke_test.go:103: Performing cleanup smoke_test.go:104: Deleting namespaces: [istio-system] smoke_test.go:104: Creating namespaces: [istio-system] smoke_test.go:103: Cleanup completed in 20.82s --- PASS: TestSmoke/delete_smcp_v2.4 (30.56s) test.go:77: test.go:82: Test completed in 244.07s (excluding cleanup) smoke_test.go:49: smoke_test.go:49: Performing cleanup smoke_test.go:50: Deleting namespaces: [istio-system] smoke_test.go:50: Creating namespaces: [istio-system] smoke_test.go:49: Cleanup completed in 5.49s --- PASS: TestSmoke (249.56s) === RUN TestSSL testssl_test.go:45: testssl_test.go:45: STEP 1: Apply default SMCP and SMMR manifests testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:47: testssl_test.go:47: STEP 2: Patch SMCP to enable mTLS in dataPlane and controlPlane and set min/maxProtocolVersion, cipherSuites, and ecdhCurves testssl_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:64: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:66: testssl_test.go:66: STEP 3: Install bookinfo with mTLS and testssl pod testssl_test.go:68: Install app "bookinfo" in namespace "bookinfo" testssl_test.go:68: Create Bookinfo Gateway testssl_test.go:68: Create Bookinfo Destination Rules (all) testssl_test.go:68: Create Bookinfo Deployments testssl_test.go:68: Wait for app bookinfo/bookinfo to be ready testssl_test.go:71: testssl_test.go:71: STEP 4: Check testssl.sh results testssl_test.go:73: SUCCESS: Received the TLSv1.2 needed in the testssl.sh results testssl_test.go:73: SUCCESS: Results received the correct SHA256 testssl_test.go:73: SUCCESS: Results included: P-256 test.go:77: test.go:82: Test completed in 42.62s (excluding cleanup) testssl_test.go:31: testssl_test.go:31: Performing cleanup testssl_test.go:41: Uninstalling Bookinfo from namespace "bookinfo" testssl_test.go:31: Cleanup completed in 1.65s --- PASS: TestSSL (44.26s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm 376.048s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestClusterWideMode test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestClusterWideMode (0.00s) === RUN TestOperatorCanReconcileSMCPWhenIstiodOffline test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOperatorCanReconcileSMCPWhenIstiodOffline (0.00s) === RUN TestOperatorPodHonorsReadinessProbe test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOperatorPodHonorsReadinessProbe (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm/operator 0.289s === RUN TestMultiClusterFederationFailover test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestMultiClusterFederationFailover (0.00s) === RUN TestFederation test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestFederation (0.00s) === RUN TestFederationDifferentCerts test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestFederationDifferentCerts (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm-federation 0.004s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestCustomPrometheus test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestCustomPrometheus (0.00s) === RUN TestOpenShiftMonitoring test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOpenShiftMonitoring (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/observability 0.271s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAuthPolicy auth_test.go:45: auth_test.go:45: STEP 1: Apply default SMCP and SMMR manifests auth_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... auth_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic auth_test.go:47: auth_test.go:47: STEP 2: Install httpbin and sleep in multiple namespaces auth_test.go:48: Install app "httpbin" in namespace "foo" auth_test.go:48: Install app "httpbin" in namespace "bar" auth_test.go:48: Install app "httpbin" in namespace "legacy" auth_test.go:48: Install app "sleep" in namespace "foo" auth_test.go:48: Install app "sleep" in namespace "bar" auth_test.go:48: Install app "sleep" in namespace "legacy" auth_test.go:48: Wait for app foo/httpbin to be ready auth_test.go:48: Wait for app bar/httpbin to be ready auth_test.go:48: Wait for app legacy/httpbin to be ready auth_test.go:48: Wait for app foo/sleep to be ready auth_test.go:48: Wait for app bar/sleep to be ready auth_test.go:48: Wait for app legacy/sleep to be ready auth_test.go:59: auth_test.go:59: STEP 3: Check connectivity from namespaces foo, bar, and legacy to namespaces foo and bar mtls_migration_test.go:118: SUCCESS: foo connects to foo mtls_migration_test.go:118: SUCCESS: foo connects to bar mtls_migration_test.go:118: SUCCESS: bar connects to foo mtls_migration_test.go:118: SUCCESS: bar connects to bar mtls_migration_test.go:118: SUCCESS: legacy connects to foo mtls_migration_test.go:118: SUCCESS: legacy connects to bar === RUN TestAuthPolicy/enable_auto_mTLS auth_test.go:69: auth_test.go:69: STEP 1: Check if mTLS is enabled in foo auth_test.go:71: SUCCESS: mTLS is enabled in namespace foo (X-Forwarded-Client-Cert header is present) auth_test.go:80: auth_test.go:80: STEP 2: Check that mTLS is NOT enabled in legacy auth_test.go:82: SUCCESS: mTLS is not enabled in namespace legacy (X-Forwarded-Client-Cert header is not present) subtest.go:23: subtest.go:28: Subtest completed in 0.49s (excluding cleanup) --- PASS: TestAuthPolicy/enable_auto_mTLS (0.49s) === RUN TestAuthPolicy/enable_global_mTLS_STRICT_mode auth_test.go:93: auth_test.go:93: STEP 1: Enable mTLS STRICT mode globally auth_test.go:102: SUCCESS: Global mTLS expected 000 auth_test.go:102: SUCCESS: Global mTLS expected 000 subtest.go:23: subtest.go:28: Subtest completed in 0.79s (excluding cleanup) auth_test.go:95: auth_test.go:95: Performing cleanup auth_test.go:95: Cleanup completed in 0.06s --- PASS: TestAuthPolicy/enable_global_mTLS_STRICT_mode (0.85s) === RUN TestAuthPolicy/namespace_policy_mtls auth_test.go:114: auth_test.go:114: STEP 1: Enable mutual TLS per namespace mtls_migration_test.go:118: SUCCESS: foo connects to foo mtls_migration_test.go:118: SUCCESS: foo connects to bar mtls_migration_test.go:118: SUCCESS: bar connects to foo mtls_migration_test.go:118: SUCCESS: bar connects to bar mtls_migration_test.go:118: SUCCESS: legacy can't conect to foo mtls_migration_test.go:118: SUCCESS: legacy connects to bar subtest.go:23: subtest.go:28: Subtest completed in 1.82s (excluding cleanup) auth_test.go:116: auth_test.go:116: Performing cleanup auth_test.go:116: Cleanup completed in 0.06s --- PASS: TestAuthPolicy/namespace_policy_mtls (1.88s) === RUN TestAuthPolicy/workload_policy_mtls auth_test.go:133: auth_test.go:133: STEP 1: Enable mutual TLS per workload mtls_migration_test.go:118: SUCCESS: legacy can't conect to bar auth_test.go:142: auth_test.go:142: STEP 2: Refine mutual TLS per port mtls_migration_test.go:118: SUCCESS: legacy connects to bar subtest.go:23: subtest.go:28: Subtest completed in 1.03s (excluding cleanup) auth_test.go:135: auth_test.go:135: Performing cleanup auth_test.go:135: Cleanup completed in 0.07s --- PASS: TestAuthPolicy/workload_policy_mtls (1.09s) === RUN TestAuthPolicy/policy_precedence_mtls auth_test.go:150: auth_test.go:150: STEP 1: Overwrite foo namespace policy by a workload policy mtls_migration_test.go:118: SUCCESS: legacy connects to foo subtest.go:23: subtest.go:28: Subtest completed in 0.50s (excluding cleanup) auth_test.go:152: auth_test.go:152: Performing cleanup auth_test.go:152: Cleanup completed in 0.07s --- PASS: TestAuthPolicy/policy_precedence_mtls (0.57s) === RUN TestAuthPolicy/end-user_JWT auth_test.go:164: End-user authentication auth_test.go:166: auth_test.go:166: STEP 1: Apply httpbin gateway auth_test.go:169: auth_test.go:169: STEP 2: Check httpbin request is successful auth_test.go:230: SUCCESS: received expected status code 200 auth_test.go:174: auth_test.go:174: STEP 3: Apply a JWT policy auth_test.go:180: auth_test.go:180: STEP 4: Check whether request without token returns 200 auth_test.go:230: SUCCESS: received expected status code 200 auth_test.go:185: auth_test.go:185: STEP 5: Check whether request with an invalid token returns 401 auth_test.go:230: FAILURE: expected status code 401 but got 200 OK auth_test.go:186: --- Attempt 1/60 failed. Retrying... auth_test.go:230: FAILURE: expected status code 401 but got 200 OK auth_test.go:186: --- Attempt 2/60 failed. Retrying... auth_test.go:230: SUCCESS: received expected status code 401 auth_test.go:186: --- Attempt 3/60 successful; total time: 2.03s auth_test.go:190: auth_test.go:190: STEP 6: Check whether request with a valid token returns 200 auth_test.go:230: SUCCESS: received expected status code 200 subtest.go:23: subtest.go:28: Subtest completed in 3.79s (excluding cleanup) auth_test.go:176: auth_test.go:176: Performing cleanup auth_test.go:176: Cleanup completed in 0.06s --- PASS: TestAuthPolicy/end-user_JWT (3.85s) === RUN TestAuthPolicy/end-user_require_JWT auth_test.go:201: Require a valid token auth_test.go:230: FAILURE: expected status code 403 but got 200 OK auth_test.go:207: --- Attempt 1/60 failed. Retrying... auth_test.go:230: SUCCESS: received expected status code 403 auth_test.go:207: --- Attempt 2/60 successful; total time: 1.01s subtest.go:23: subtest.go:28: Subtest completed in 1.30s (excluding cleanup) auth_test.go:203: auth_test.go:203: Performing cleanup auth_test.go:203: Cleanup completed in 0.06s --- PASS: TestAuthPolicy/end-user_require_JWT (1.36s) === RUN TestAuthPolicy/end-user_require_JWT_per_path auth_test.go:213: Require valid tokens per-path auth_test.go:230: FAILURE: expected status code 403 but got 200 OK auth_test.go:219: --- Attempt 1/60 failed. Retrying... auth_test.go:230: FAILURE: expected status code 403 but got 200 OK auth_test.go:219: --- Attempt 2/60 failed. Retrying... auth_test.go:230: SUCCESS: received expected status code 403 auth_test.go:230: SUCCESS: received expected status code 200 auth_test.go:219: --- Attempt 3/60 successful; total time: 2.02s subtest.go:23: subtest.go:28: Subtest completed in 2.32s (excluding cleanup) auth_test.go:215: auth_test.go:215: Performing cleanup auth_test.go:215: Cleanup completed in 0.06s --- PASS: TestAuthPolicy/end-user_require_JWT_per_path (2.38s) test.go:77: test.go:82: Test completed in 34.85s (excluding cleanup) auth_test.go:41: auth_test.go:41: Performing cleanup auth_test.go:42: Deleting namespaces: [foo bar legacy] auth_test.go:42: Creating namespaces: [foo bar legacy] auth_test.go:41: Cleanup completed in 34.40s --- PASS: TestAuthPolicy (69.25s) === RUN TestMTlsMigration mtls_migration_test.go:40: mtls_migration_test.go:40: STEP 1: Apply default SMCP and SMMR manifests mtls_migration_test.go:40: Wait for condition condition=Ready on smcp istio-system/basic... mtls_migration_test.go:40: SUCCESS: Condition condition=Ready met by smcp istio-system/basic mtls_migration_test.go:42: mtls_migration_test.go:42: STEP 2: Install httpbin and sleep in multiple namespaces mtls_migration_test.go:43: Install app "httpbin" in namespace "foo" mtls_migration_test.go:43: Install app "httpbin" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "foo" mtls_migration_test.go:43: Install app "sleep" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "legacy" mtls_migration_test.go:43: Wait for app foo/httpbin to be ready mtls_migration_test.go:43: Wait for app bar/httpbin to be ready mtls_migration_test.go:43: Wait for app foo/sleep to be ready mtls_migration_test.go:43: Wait for app bar/sleep to be ready mtls_migration_test.go:43: Wait for app legacy/sleep to be ready mtls_migration_test.go:53: mtls_migration_test.go:53: STEP 3: Check connectivity from namespaces foo, bar, and legacy to namespace foo and bar mtls_migration_test.go:118: SUCCESS: foo connects to foo mtls_migration_test.go:118: SUCCESS: foo connects to bar mtls_migration_test.go:118: SUCCESS: bar connects to foo mtls_migration_test.go:118: SUCCESS: bar connects to bar mtls_migration_test.go:118: SUCCESS: legacy connects to foo mtls_migration_test.go:118: SUCCESS: legacy connects to bar === RUN TestMTlsMigration/mTLS_enabled_in_foo mtls_migration_test.go:63: mtls_migration_test.go:63: STEP 1: Apply strict mTLS in namespace foo mtls_migration_test.go:66: mtls_migration_test.go:66: STEP 2: Check connectivity from namespaces foo, bar, and legacy to namespace foo and bar (expect failure only from legacy to foo) mtls_migration_test.go:118: SUCCESS: foo connects to foo mtls_migration_test.go:118: SUCCESS: foo connects to bar mtls_migration_test.go:118: SUCCESS: bar connects to foo mtls_migration_test.go:118: SUCCESS: bar connects to bar mtls_migration_test.go:118: SUCCESS: legacy can't conect to foo mtls_migration_test.go:118: SUCCESS: legacy connects to bar subtest.go:23: subtest.go:28: Subtest completed in 1.68s (excluding cleanup) --- PASS: TestMTlsMigration/mTLS_enabled_in_foo (1.68s) === RUN TestMTlsMigration/mTLS_enabled_globally mtls_migration_test.go:81: mtls_migration_test.go:81: STEP 1: Apply strict mTLS for the entire mesh mtls_migration_test.go:87: mtls_migration_test.go:87: STEP 2: Check connectivity from namespaces foo, bar, and legacy to namespace foo and bar (expect failure from legacy) mtls_migration_test.go:118: SUCCESS: foo connects to foo mtls_migration_test.go:118: SUCCESS: foo connects to bar mtls_migration_test.go:118: SUCCESS: bar connects to foo mtls_migration_test.go:118: SUCCESS: bar connects to bar mtls_migration_test.go:118: SUCCESS: legacy can't conect to foo mtls_migration_test.go:118: SUCCESS: legacy can't conect to bar subtest.go:23: subtest.go:28: Subtest completed in 1.60s (excluding cleanup) mtls_migration_test.go:83: mtls_migration_test.go:83: Performing cleanup mtls_migration_test.go:83: Cleanup completed in 0.06s --- PASS: TestMTlsMigration/mTLS_enabled_globally (1.66s) test.go:77: test.go:82: Test completed in 16.72s (excluding cleanup) mtls_migration_test.go:36: mtls_migration_test.go:36: Performing cleanup mtls_migration_test.go:37: Deleting namespaces: [foo bar legacy] mtls_migration_test.go:37: Creating namespaces: [foo bar legacy] mtls_migration_test.go:36: Cleanup completed in 18.63s --- PASS: TestMTlsMigration (35.35s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/authentication 104.894s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAuthorizationDenyAllow deny_test.go:33: This test validates authorization policies with a deny action deny_test.go:35: deny_test.go:35: STEP 1: Apply default SMCP and SMMR manifests deny_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... deny_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic deny_test.go:37: deny_test.go:37: STEP 2: Install httpbin and sleep deny_test.go:38: Install app "httpbin" in namespace "foo" deny_test.go:38: Install app "sleep" in namespace "foo" deny_test.go:38: Wait for app foo/httpbin to be ready deny_test.go:38: Wait for app foo/sleep to be ready deny_test.go:40: deny_test.go:40: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place deny_test.go:41: SUCCESS: Got expected 200 OK from httpbin === RUN TestAuthorizationDenyAllow/explicitly_deny_request deny_test.go:47: deny_test.go:47: STEP 1: Apply policy that denies all GET requests to httpbin deny_test.go:50: deny_test.go:50: STEP 2: Verify that GET request is denied deny_test.go:51: FAILURE: Expected the AuthorizationPolicy to reject request (expected HTTP status 403), but got a different HTTP code; expected to find the string '403' in the output, but it wasn't found deny_test.go:51: --- Attempt 1/60 failed. Retrying... deny_test.go:51: SUCCESS: Got the expected 403 response code deny_test.go:51: --- Attempt 2/60 successful; total time: 1.51s deny_test.go:53: deny_test.go:53: STEP 3: Verify that POST request is allowed deny_test.go:54: SUCCESS: Got the expected 200 OK response for request from httpbin subtest.go:23: subtest.go:28: Subtest completed in 2.05s (excluding cleanup) deny_test.go:44: deny_test.go:44: Performing cleanup deny_test.go:44: Cleanup completed in 0.07s --- PASS: TestAuthorizationDenyAllow/explicitly_deny_request (2.11s) === RUN TestAuthorizationDenyAllow/deny_request_header deny_test.go:61: deny_test.go:61: STEP 1: Apply policy that denies GET requests unless the HTTP header 'x-token: admin' is present deny_test.go:64: deny_test.go:64: STEP 2: Verify that GET request with HTTP header 'x-token: admin' is allowed deny_test.go:65: FAILURE: Expected the AuthorizationPolicy to accept request (expected HTTP status 200), but got a different HTTP code; expected to find the string '200' in the output, but it wasn't found deny_test.go:65: --- Attempt 1/60 failed. Retrying... deny_test.go:65: SUCCESS: Got the expected 200 OK response for request from httpbin deny_test.go:65: --- Attempt 2/60 successful; total time: 1.45s deny_test.go:67: deny_test.go:67: STEP 3: Verify that GET request with HTTP header 'x-token: guest' is denied deny_test.go:68: SUCCESS: Got the expected 403 response code subtest.go:23: subtest.go:28: Subtest completed in 1.93s (excluding cleanup) deny_test.go:58: deny_test.go:58: Performing cleanup deny_test.go:58: Cleanup completed in 0.06s --- PASS: TestAuthorizationDenyAllow/deny_request_header (2.00s) === RUN TestAuthorizationDenyAllow/allow_request_path deny_test.go:76: deny_test.go:76: STEP 1: Apply policy that denies GET requests unless the HTTP header 'x-token: admin' is present deny_test.go:79: deny_test.go:79: STEP 2: Apply policy that allows requests with the path '/ip' deny_test.go:82: deny_test.go:82: STEP 3: Verify that GET request with the HTTP header 'x-token: guest' at path '/ip' is denied deny_test.go:83: SUCCESS: Got the expected 403 response code deny_test.go:85: deny_test.go:85: STEP 4: Verify that GET request with HTTP header 'x-token: admin' at path '/ip' is allowed deny_test.go:86: FAILURE: Expected the AuthorizationPolicy to accept request (expected HTTP status 200), but got a different HTTP code; expected to find the string '200' in the output, but it wasn't found deny_test.go:86: --- Attempt 1/60 failed. Retrying... deny_test.go:86: SUCCESS: Got the expected 200 OK response for request from httpbin deny_test.go:86: --- Attempt 2/60 successful; total time: 1.49s deny_test.go:88: deny_test.go:88: STEP 5: Verify that GET request with HTTP header 'x-token: admin' at path '/get' is denied deny_test.go:89: SUCCESS: Got the expected 403 response code subtest.go:23: subtest.go:28: Subtest completed in 2.52s (excluding cleanup) deny_test.go:72: deny_test.go:72: Performing cleanup deny_test.go:72: Cleanup completed in 0.12s --- PASS: TestAuthorizationDenyAllow/allow_request_path (2.64s) test.go:77: test.go:82: Test completed in 17.97s (excluding cleanup) deny_test.go:29: deny_test.go:29: Performing cleanup deny_test.go:30: Deleting namespaces: [foo] deny_test.go:30: Creating namespaces: [foo] deny_test.go:29: Cleanup completed in 17.27s --- PASS: TestAuthorizationDenyAllow (35.24s) === RUN TestEnvoyExtAuthzHttpExtensionProvider ext_auth_test.go:33: This test validates authorization policies with a JWT Token ext_auth_test.go:37: ext_auth_test.go:37: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:39: ext_auth_test.go:39: STEP 2: Install httpbin and sleep ext_auth_test.go:40: Install app "httpbin" in namespace "foo" ext_auth_test.go:40: Install app "sleep" in namespace "foo" ext_auth_test.go:40: Wait for app foo/httpbin to be ready ext_auth_test.go:40: Wait for app foo/sleep to be ready ext_auth_test.go:45: ext_auth_test.go:45: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place ext_auth_test.go:46: SUCCESS: Got expected 200 OK from httpbin ext_auth_test.go:48: ext_auth_test.go:48: STEP 4: Deploy the External Authorizer and Verify the sample external authorizer is up and running ext_auth_test.go:56: ext_auth_test.go:56: STEP 5: Set envoyExtAuthzHttp extension provider in SMCP ext_auth_test.go:93: ext_auth_test.go:93: STEP 6: Deploy the external authorization in the Authorization policy ext_auth_test.go:99: ext_auth_test.go:99: STEP 7: Verify a request to path /headers with header x-ext-authz: deny is denied by the sample ext_authz server: ext_auth_test.go:100: FAILURE: Expected the AuthorizationPolicy to reject request (expected HTTP status 403), but got a different HTTP code; expected to find the string '403' in the output, but it wasn't found ext_auth_test.go:100: --- Attempt 1/60 failed. Retrying... ext_auth_test.go:100: SUCCESS: Got the expected 403 response code ext_auth_test.go:100: --- Attempt 2/60 successful; total time: 1.51s ext_auth_test.go:102: ext_auth_test.go:102: STEP 8: Verify a request to path /headers with header x-ext-authz: allow is allowed by the sample ext_authz server ext_auth_test.go:103: SUCCESS: Got the expected 200 OK response for request from httpbin ext_auth_test.go:105: ext_auth_test.go:105: STEP 9: Verify a request to path /ip is allowed and does not trigger the external authorization ext_auth_test.go:106: SUCCESS: Got expected 200 OK from httpbin test.go:77: test.go:82: Test completed in 17.67s (excluding cleanup) ext_auth_test.go:94: ext_auth_test.go:94: Performing cleanup ext_auth_test.go:94: Cleanup completed in 0.06s ext_auth_test.go:87: ext_auth_test.go:87: Performing cleanup ext_auth_test.go:87: Cleanup completed in 0.09s ext_auth_test.go:50: ext_auth_test.go:50: Performing cleanup ext_auth_test.go:50: Cleanup completed in 0.09s ext_auth_test.go:41: ext_auth_test.go:41: Performing cleanup ext_auth_test.go:41: Cleanup completed in 0.32s --- PASS: TestEnvoyExtAuthzHttpExtensionProvider (18.23s) === RUN TestEnvoyExtAuthzGrpcExtensionProvider ext_auth_test.go:115: This test validates authorization policies with a JWT Token ext_auth_test.go:119: ext_auth_test.go:119: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:119: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:119: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:121: ext_auth_test.go:121: STEP 2: Install httpbin and sleep ext_auth_test.go:122: Install app "httpbin" in namespace "foo" ext_auth_test.go:122: Install app "sleep" in namespace "foo" ext_auth_test.go:122: Wait for app foo/httpbin to be ready ext_auth_test.go:122: Wait for app foo/sleep to be ready ext_auth_test.go:127: ext_auth_test.go:127: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place ext_auth_test.go:128: SUCCESS: Got expected 200 OK from httpbin ext_auth_test.go:130: ext_auth_test.go:130: STEP 4: Deploy the External Authorizer and Verify the sample external authorizer is up and running ext_auth_test.go:138: ext_auth_test.go:138: STEP 5: Set envoyExtAuthzgRPC extension provider in SMCP ext_auth_test.go:159: ext_auth_test.go:159: STEP 6: Deploy the external authorization in the Authorization policy ext_auth_test.go:165: ext_auth_test.go:165: STEP 7: Verify a request to path /headers with header x-ext-authz: deny is denied by the sample ext_authz server: ext_auth_test.go:166: FAILURE: Expected the AuthorizationPolicy to reject request (expected HTTP status 403), but got a different HTTP code; expected to find the string '403' in the output, but it wasn't found ext_auth_test.go:166: --- Attempt 1/60 failed. Retrying... ext_auth_test.go:166: SUCCESS: Got the expected 403 response code ext_auth_test.go:166: --- Attempt 2/60 successful; total time: 1.54s ext_auth_test.go:168: ext_auth_test.go:168: STEP 8: Verify a request to path /headers with header x-ext-authz: allow is allowed by the sample ext_authz server ext_auth_test.go:169: SUCCESS: Got the expected 200 OK response for request from httpbin ext_auth_test.go:171: ext_auth_test.go:171: STEP 9: Verify a request to path /ip is allowed and does not trigger the external authorization ext_auth_test.go:172: SUCCESS: Got expected 200 OK from httpbin test.go:77: test.go:82: Test completed in 17.46s (excluding cleanup) ext_auth_test.go:160: ext_auth_test.go:160: Performing cleanup ext_auth_test.go:160: Cleanup completed in 0.06s ext_auth_test.go:152: ext_auth_test.go:152: Performing cleanup ext_auth_test.go:152: Cleanup completed in 0.08s ext_auth_test.go:132: ext_auth_test.go:132: Performing cleanup ext_auth_test.go:132: Cleanup completed in 0.09s ext_auth_test.go:123: ext_auth_test.go:123: Performing cleanup ext_auth_test.go:123: Cleanup completed in 0.27s --- PASS: TestEnvoyExtAuthzGrpcExtensionProvider (17.95s) === RUN TestAuthorizationHTTPTraffic http_test.go:42: This test validates authorization policies for HTTP traffic. http_test.go:43: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-http/ http_test.go:45: http_test.go:45: STEP 1: Apply default SMCP and SMMR manifests http_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:47: http_test.go:47: STEP 2: Enable Service Mesh Control Plane mTLS http_test.go:53: http_test.go:53: STEP 3: Install bookinfo with mTLS http_test.go:54: Install app "bookinfo" in namespace "bookinfo" http_test.go:54: Create Bookinfo Gateway http_test.go:54: Create Bookinfo Destination Rules (all) http_test.go:54: Create Bookinfo Deployments http_test.go:54: Wait for app bookinfo/bookinfo to be ready http_test.go:55: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:55: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestAuthorizationHTTPTraffic/deny_all_http_traffic_to_bookinfo http_test.go:63: http_test.go:63: STEP 1: Apply policy that denies all HTTP requests to bookinfo workloads http_test.go:66: http_test.go:66: STEP 2: Verify that GET request is denied http_test.go:68: FAILURE: expected to find the string 'RBAC: access denied' in the response, but it wasn't found http_test.go:67: --- Attempt 1/60 failed. Retrying... http_test.go:68: SUCCESS: string 'RBAC: access denied' found in response http_test.go:67: --- Attempt 2/60 successful; total time: 1.46s subtest.go:23: subtest.go:28: Subtest completed in 1.74s (excluding cleanup) http_test.go:60: http_test.go:60: Performing cleanup http_test.go:60: Cleanup completed in 0.07s --- PASS: TestAuthorizationHTTPTraffic/deny_all_http_traffic_to_bookinfo (1.81s) === RUN TestAuthorizationHTTPTraffic/only_allow_HTTP_GET_request_to_the_productpage_workload http_test.go:81: http_test.go:81: STEP 1: Apply policies that allow access with GET method to the productpage workload and deny requests to other workloads http_test.go:85: http_test.go:85: STEP 2: Verify that GET request to the productpage is allowed and fetching other services is denied http_test.go:87: FAILURE: expected to find the string 'Error fetching product details' in the response, but it wasn't found http_test.go:87: FAILURE: expected to find the string 'Error fetching product reviews' in the response, but it wasn't found http_test.go:86: --- Attempt 1/60 failed. Retrying... http_test.go:87: SUCCESS: string 'Error fetching product details' found in response http_test.go:87: SUCCESS: string 'Error fetching product reviews' found in response http_test.go:86: --- Attempt 2/60 successful; total time: 1.06s subtest.go:23: subtest.go:28: Subtest completed in 1.69s (excluding cleanup) http_test.go:77: http_test.go:77: Performing cleanup http_test.go:77: Cleanup completed in 0.12s --- PASS: TestAuthorizationHTTPTraffic/only_allow_HTTP_GET_request_to_the_productpage_workload (1.81s) === RUN TestAuthorizationHTTPTraffic/allow_HTTP_GET_requests_to_all_bookinfo_workloads http_test.go:104: http_test.go:104: STEP 1: Apply policies that allow HTTP GET requests to all bookinfo workloads http_test.go:111: http_test.go:111: STEP 2: Verify that GET requests are allowed to all bookinfo workloads http_test.go:113: SUCCESS: string 'RBAC: access denied' not found in response http_test.go:113: SUCCESS: string 'Error fetching product details' not found in response http_test.go:113: SUCCESS: string 'Error fetching product reviews' not found in response http_test.go:113: SUCCESS: string 'Ratings service currently unavailable' not found in response subtest.go:23: subtest.go:28: Subtest completed in 1.89s (excluding cleanup) http_test.go:97: http_test.go:97: Performing cleanup http_test.go:97: Cleanup completed in 0.30s --- PASS: TestAuthorizationHTTPTraffic/allow_HTTP_GET_requests_to_all_bookinfo_workloads (2.19s) test.go:77: test.go:82: Test completed in 27.60s (excluding cleanup) http_test.go:33: http_test.go:33: Performing cleanup http_test.go:38: Deleting namespaces: [bookinfo] http_test.go:38: Creating namespaces: [bookinfo] http_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:39: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:33: Cleanup completed in 14.04s --- PASS: TestAuthorizationHTTPTraffic (41.64s) === RUN TestAuthorizationJWT jwt_test.go:35: This test validates authorization policies with JWT Token jwt_test.go:37: jwt_test.go:37: STEP 1: Apply default SMCP and SMMR manifests jwt_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... jwt_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic jwt_test.go:39: jwt_test.go:39: STEP 2: Install httpbin and sleep jwt_test.go:40: Install app "httpbin" in namespace "foo" jwt_test.go:40: Install app "sleep" in namespace "foo" jwt_test.go:40: Wait for app foo/httpbin to be ready jwt_test.go:40: Wait for app foo/sleep to be ready jwt_test.go:42: jwt_test.go:42: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place jwt_test.go:43: SUCCESS: Got expected 200 OK from httpbin === RUN TestAuthorizationJWT/Allow_requests_with_valid_JWT_and_list-typed_claims jwt_test.go:57: jwt_test.go:57: STEP 1: Verify that a request with an invalid JWT is denied jwt_test.go:58: SUCCESS: Got the expected 401 response code jwt_test.go:60: jwt_test.go:60: STEP 2: Verify that a request without a JWT is allowed because there is no authorization policy jwt_test.go:61: SUCCESS: Got the expected 200 OK response for request from httpbin subtest.go:23: subtest.go:28: Subtest completed in 0.46s (excluding cleanup) --- PASS: TestAuthorizationJWT/Allow_requests_with_valid_JWT_and_list-typed_claims (0.46s) === RUN TestAuthorizationJWT/Security_authorization_allow_JWT_requestPrincipal jwt_test.go:69: jwt_test.go:69: STEP 1: Verify that a request with a valid JWT is allowed jwt_test.go:70: SUCCESS: Got the expected 200 OK response for request from httpbin jwt_test.go:72: jwt_test.go:72: STEP 2: Verify request without a JWT is denied jwt_test.go:73: FAILURE: Expected the AuthorizationPolicy to reject request (expected HTTP status 403), but got a different HTTP code; expected to find the string '403' in the output, but it wasn't found jwt_test.go:73: --- Attempt 1/60 failed. Retrying... jwt_test.go:73: SUCCESS: Got the expected 403 response code jwt_test.go:73: --- Attempt 2/60 successful; total time: 1.49s subtest.go:23: subtest.go:28: Subtest completed in 1.97s (excluding cleanup) jwt_test.go:65: jwt_test.go:65: Performing cleanup jwt_test.go:65: Cleanup completed in 0.06s --- PASS: TestAuthorizationJWT/Security_authorization_allow_JWT_requestPrincipal (2.04s) === RUN TestAuthorizationJWT/Security_authorization_allow_JWT_claims_group jwt_test.go:81: jwt_test.go:81: STEP 1: Verify that a request with the JWT that includes group1 in the groups claim is allowed jwt_test.go:82: SUCCESS: Got the expected 200 OK response for request from httpbin jwt_test.go:84: jwt_test.go:84: STEP 2: Verify that a request with a JWT, which does not have the groups claim is rejected jwt_test.go:85: SUCCESS: Got the expected 403 response code subtest.go:23: subtest.go:28: Subtest completed in 0.74s (excluding cleanup) jwt_test.go:77: jwt_test.go:77: Performing cleanup jwt_test.go:77: Cleanup completed in 0.06s --- PASS: TestAuthorizationJWT/Security_authorization_allow_JWT_claims_group (0.80s) test.go:77: test.go:82: Test completed in 14.95s (excluding cleanup) jwt_test.go:51: jwt_test.go:51: Performing cleanup jwt_test.go:51: Cleanup completed in 0.06s jwt_test.go:31: jwt_test.go:31: Performing cleanup jwt_test.go:32: Deleting namespaces: [foo] jwt_test.go:32: Creating namespaces: [foo] jwt_test.go:31: Cleanup completed in 17.55s --- PASS: TestAuthorizationJWT (32.56s) === RUN TestAuthorizationTCPTraffic tcp_test.go:38: This test validates authorization policies for TCP traffic. tcp_test.go:39: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-tcp/ tcp_test.go:41: tcp_test.go:41: STEP 1: Apply default SMCP and SMMR manifests tcp_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... tcp_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic tcp_test.go:43: tcp_test.go:43: STEP 2: Install sleep and echo tcp_test.go:44: Install app "sleep" in namespace "foo" tcp_test.go:44: Install app "echo" in namespace "foo" tcp_test.go:44: Wait for app foo/sleep to be ready tcp_test.go:44: Wait for app foo/echo to be ready tcp_test.go:47: tcp_test.go:47: STEP 3: Verify sleep to echo TCP connections tcp_test.go:103: SUCCESS: Got expected hello message on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 1/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 2/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 3/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 4/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 5/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 6/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 7/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 8/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 9/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 10/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 11/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 12/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 13/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 14/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 15/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 16/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 17/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 18/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 19/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 20/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 21/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 22/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 23/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 24/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 25/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 26/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 27/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 28/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 29/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 30/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 31/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 32/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 33/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 34/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 35/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 36/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 37/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 38/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 39/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 40/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 41/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 42/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 43/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 44/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 45/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 46/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 47/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 48/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 49/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 50/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 51/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 52/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 53/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 54/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 55/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 56/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 57/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 58/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 59/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 60/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 61/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 62/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 63/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 64/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 65/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 66/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 67/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 68/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 69/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 70/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 71/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 72/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 73/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 74/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 75/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 76/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 77/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 78/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 79/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 80/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 81/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 82/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 83/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 84/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 85/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 86/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 87/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 88/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 89/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 90/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 91/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 92/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 93/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 94/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 95/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 96/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 97/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 98/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 99/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 100/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 101/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 102/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 103/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 104/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 105/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 106/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 107/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 108/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 109/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 110/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 111/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 112/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 113/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 114/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 115/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 116/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 117/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 118/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 119/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found; full output: connection rejected tcp_test.go:53: Last attempt (120/120) failed. === RUN TestAuthorizationTCPTraffic/TCP_ALLOW_policy tcp_test.go:61: tcp_test.go:61: STEP 1: Apply a policy to allow tcp requests to port 9000 and 9001 tcp_test.go:103: SUCCESS: Got expected hello message on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9002 subtest.go:23: subtest.go:28: Subtest completed in 1.43s (excluding cleanup) tcp_test.go:58: tcp_test.go:58: Performing cleanup tcp_test.go:58: Cleanup completed in 0.09s --- PASS: TestAuthorizationTCPTraffic/TCP_ALLOW_policy (1.52s) === RUN TestAuthorizationTCPTraffic/TCP_invalid_policy tcp_test.go:78: tcp_test.go:78: STEP 1: Apply an invalid policy to allow requests to port 9000 and add an HTTP GET field tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 1.14s (excluding cleanup) tcp_test.go:75: tcp_test.go:75: Performing cleanup tcp_test.go:75: Cleanup completed in 0.06s --- PASS: TestAuthorizationTCPTraffic/TCP_invalid_policy (1.21s) === RUN TestAuthorizationTCPTraffic/TCP_deny_policy tcp_test.go:91: tcp_test.go:91: STEP 1: Apply a policy to deny tcp requests to port 9000 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 0.92s (excluding cleanup) tcp_test.go:88: tcp_test.go:88: Performing cleanup tcp_test.go:88: Cleanup completed in 0.06s --- PASS: TestAuthorizationTCPTraffic/TCP_deny_policy (0.99s) test.go:77: test.go:79: Test failed in 167.95s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230717063758/v2.4/failures-must-gather/20230717065130-TestAuthorizationTCPTraffic tcp_test.go:34: tcp_test.go:34: Performing cleanup tcp_test.go:35: Deleting namespaces: [foo] tcp_test.go:35: Creating namespaces: [foo] tcp_test.go:34: Cleanup completed in 11.87s --- FAIL: TestAuthorizationTCPTraffic (222.81s) === RUN TestTrustDomainMigration trust_domain_test.go:49: trust_domain_test.go:49: STEP 1: Apply default SMCP and SMMR manifests trust_domain_test.go:49: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:49: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:96: Configure spec.security.trust.domain to "old-td" and alias "" trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:53: Install app "httpbin" in namespace "foo" trust_domain_test.go:53: Install app "sleep" in namespace "foo" trust_domain_test.go:53: Install app "sleep" in namespace "bar" trust_domain_test.go:53: Wait for app foo/httpbin to be ready trust_domain_test.go:53: Wait for app foo/sleep to be ready trust_domain_test.go:53: Wait for app bar/sleep to be ready trust_domain_test.go:58: Apply deny all policy except sleep in bar namespace === RUN TestTrustDomainMigration/Case_1:_Verifying_policy_works trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:87: SUCCESS: string '403' found in output trust_domain_test.go:85: Verifying curl output, expecting 200 trust_domain_test.go:87: SUCCESS: string '200' found in output subtest.go:23: subtest.go:28: Subtest completed in 0.55s (excluding cleanup) --- PASS: TestTrustDomainMigration/Case_1:_Verifying_policy_works (0.55s) === RUN TestTrustDomainMigration/Case_2:_Migrate_trust_domain_without_trust_domain_aliases trust_domain_test.go:96: Configure spec.security.trust.domain to "new-td" and alias "" trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:87: SUCCESS: string '403' found in output trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:87: SUCCESS: string '403' found in output subtest.go:23: subtest.go:28: Subtest completed in 18.45s (excluding cleanup) --- PASS: TestTrustDomainMigration/Case_2:_Migrate_trust_domain_without_trust_domain_aliases (18.45s) === RUN TestTrustDomainMigration/Case_3:_Migrate_trust_domain_with_trust_domain_aliases trust_domain_test.go:96: Configure spec.security.trust.domain to "new-td" and alias "old-td" trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:87: SUCCESS: string '403' found in output trust_domain_test.go:85: Verifying curl output, expecting 200 trust_domain_test.go:87: SUCCESS: string '200' found in output subtest.go:23: subtest.go:28: Subtest completed in 24.08s (excluding cleanup) --- PASS: TestTrustDomainMigration/Case_3:_Migrate_trust_domain_with_trust_domain_aliases (24.08s) test.go:77: test.go:82: Test completed in 64.79s (excluding cleanup) trust_domain_test.go:39: trust_domain_test.go:39: Performing cleanup trust_domain_test.go:39: Cleanup completed in 0.72s --- PASS: TestTrustDomainMigration (65.51s) FAIL FAIL github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/authorization 434.210s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestExternalCertificate external_ca_test.go:48: external_ca_test.go:48: STEP 1: Uninstall existing SMCP external_ca_test.go:49: Deleting namespaces: [istio-system] external_ca_test.go:49: Creating namespaces: [istio-system] external_ca_test.go:51: external_ca_test.go:51: STEP 2: Create cacerts secret external_ca_test.go:60: external_ca_test.go:60: STEP 3: Apply SMCP to configure certificate authority to use cacerts secret external_ca_test.go:62: Wait for condition condition=Ready on smcp istio-system/basic... external_ca_test.go:62: SUCCESS: Condition condition=Ready met by smcp istio-system/basic external_ca_test.go:64: external_ca_test.go:64: STEP 4: Install bookinfo external_ca_test.go:65: Install app "bookinfo" in namespace "bookinfo" external_ca_test.go:65: Create Bookinfo Gateway external_ca_test.go:65: Create Bookinfo Destination Rules (all) external_ca_test.go:65: Create Bookinfo Deployments external_ca_test.go:65: Wait for app bookinfo/bookinfo to be ready external_ca_test.go:67: external_ca_test.go:67: STEP 5: Wait for response from productpage app external_ca_test.go:69: SUCCESS: received expected status code 200 external_ca_test.go:74: external_ca_test.go:74: STEP 6: Retrieve certificates from bookinfo details service external_ca_test.go:86: SUCCESS: The cert-chain certificates are present in the certificates sent by the tested service external_ca_test.go:90: SUCCESS: Certificate trust chain successfully verified test.go:77: test.go:82: Test completed in 90.58s (excluding cleanup) external_ca_test.go:37: external_ca_test.go:37: Performing cleanup external_ca_test.go:38: Recreate namespace bookinfo external_ca_test.go:39: Deleting namespaces: [bookinfo istio-system] external_ca_test.go:39: Creating namespaces: [bookinfo istio-system] external_ca_test.go:37: Cleanup completed in 40.58s --- PASS: TestExternalCertificate (131.16s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/certificate 131.524s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestIstioCsr install.go:32: cert-manager-operator is not installed, starting installation install.go:59: install.go:59: STEP 1: Create namespace for cert-manager-operator install.go:60: Creating namespaces: [cert-manager-operator] install.go:62: install.go:62: STEP 2: Install cert-manager-operator install.go:67: Waiting for cert-manager-operator to succeed install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 1/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 2/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 3/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 4/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 5/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 6/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 7/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 8/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 9/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 10/60 failed. Retrying... install.go:71: FAILURE: cert-manager-operator is not yet installed install.go:69: --- Attempt 11/60 failed. Retrying... install.go:69: --- Attempt 12/60 successful; total time: 11.75s install.go:75: Wait for condition jsonpath='{.status.phase}'=Succeeded on csv cert-manager-operator/cert-manager-operator.v1.11.1... install.go:75: SUCCESS: Condition jsonpath='{.status.phase}'=Succeeded met by csv cert-manager-operator/cert-manager-operator.v1.11.1 install.go:76: Pod cert-manager-operator-controller-manager-c5c6bddcf-dsnsn in namespace cert-manager-operator is ready! install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 1/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 2/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 3/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 4/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 5/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 6/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 7/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 8/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 9/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 10/60 failed. Retrying in 4s... install.go:77: FAILURE: no pods found using selector app=cert-manager in namespace cert-manager install.go:77: --- Attempt 11/60 failed. Retrying in 4s... install.go:77: Pod cert-manager-84b449cdff-lfmj4 in namespace cert-manager is ready! install.go:77: --- Attempt 12/60 successful; total time: 45.08s install.go:41: install.go:41: STEP 3: Create root ca istio_csr_test.go:63: istio_csr_test.go:63: STEP 4: Uninstall existing SMCP istio_csr_test.go:64: Deleting namespaces: [istio-system] istio_csr_test.go:64: Creating namespaces: [istio-system] istio_csr_test.go:66: istio_csr_test.go:66: STEP 5: Create intermediate certificate for Istio istio_csr_test.go:69: istio_csr_test.go:69: STEP 6: Add jetstack repo to helm istio_csr_test.go:72: istio_csr_test.go:72: STEP 7: Install cert-manager-istio-csr istio_csr_test.go:81: istio_csr_test.go:81: STEP 8: Deploy SMCP v2.4 and SMMR istio_csr_test.go:83: Wait for condition condition=Ready on smcp istio-system/basic... istio_csr_test.go:83: SUCCESS: Condition condition=Ready met by smcp istio-system/basic istio_csr_test.go:85: istio_csr_test.go:85: STEP 9: Verify that istio-ca-root-cert created in Istio and member namespaces istio_csr_test.go:87: SUCCESS: istio-ca-root-cert created or updated in istio-system istio_csr_test.go:87: SUCCESS: istio-ca-root-cert created or updated in foo istio_csr_test.go:92: istio_csr_test.go:92: STEP 10: Verify that istio-ca-root-cert not created in non-member namespaces istio_csr_test.go:93: SUCCESS: istio-ca-root-cert not created in bar istio_csr_test.go:99: istio_csr_test.go:99: STEP 11: Deploy httpbin and sleep istio_csr_test.go:100: Install app "httpbin" in namespace "foo" istio_csr_test.go:100: Install app "sleep" in namespace "foo" istio_csr_test.go:100: Wait for app foo/httpbin to be ready istio_csr_test.go:100: Wait for app foo/sleep to be ready istio_csr_test.go:102: istio_csr_test.go:102: STEP 12: Check if httpbin returns 200 OK istio_csr_test.go:104: SUCCESS: Got expected 200 OK from httpbin istio_csr_test.go:114: istio_csr_test.go:114: STEP 13: Check mTLS traffic from ingress gateway to httpbin istio_csr_test.go:118: SUCCESS: received expected status code 200 test.go:77: test.go:82: Test completed in 95.03s (excluding cleanup) istio_csr_test.go:52: istio_csr_test.go:52: Performing cleanup istio_csr_test.go:58: Deleting namespaces: [foo] istio_csr_test.go:58: Creating namespaces: [foo] istio_csr_test.go:52: Cleanup completed in 30.69s --- PASS: TestIstioCsr (125.72s) === RUN TestPluginCaCert install.go:30: cert-manager-operator is already installed plugin_ca_test.go:58: plugin_ca_test.go:58: STEP 1: Uninstall existing SMCP plugin_ca_test.go:59: Deleting namespaces: [istio-system] plugin_ca_test.go:59: Creating namespaces: [istio-system] plugin_ca_test.go:61: plugin_ca_test.go:61: STEP 2: Create intermediate CA certificate for Istio plugin_ca_test.go:64: plugin_ca_test.go:64: STEP 3: Deploy SMCP v2.4 and SMMR plugin_ca_test.go:66: Wait for condition condition=Ready on smcp istio-system/basic... plugin_ca_test.go:66: SUCCESS: Condition condition=Ready met by smcp istio-system/basic plugin_ca_test.go:68: plugin_ca_test.go:68: STEP 4: Verify that cacerts secret was detected plugin_ca_test.go:70: SUCCESS: Istiod detected cacerts secret correctly plugin_ca_test.go:76: plugin_ca_test.go:76: STEP 5: Deploy httpbin and sleep plugin_ca_test.go:77: Install app "httpbin" in namespace "foo" plugin_ca_test.go:77: Install app "sleep" in namespace "foo" plugin_ca_test.go:77: Wait for app foo/httpbin to be ready plugin_ca_test.go:77: Wait for app foo/sleep to be ready plugin_ca_test.go:79: plugin_ca_test.go:79: STEP 6: Check if httpbin returns 200 OK plugin_ca_test.go:81: SUCCESS: Got expected 200 OK from httpbin plugin_ca_test.go:91: plugin_ca_test.go:91: STEP 7: Check mTLS traffic from ingress gateway to httpbin plugin_ca_test.go:95: SUCCESS: received expected status code 200 plugin_ca_test.go:98: plugin_ca_test.go:98: STEP 8: Check current istiod generation plugin_ca_test.go:101: plugin_ca_test.go:101: STEP 9: Trigger CA cert rotation plugin_ca_test.go:104: plugin_ca_test.go:104: STEP 10: Wait until certificates reloaded plugin_ca_test.go:106: SUCCESS: Istiod detected cacerts secret correctly plugin_ca_test.go:119: plugin_ca_test.go:119: STEP 11: Trigger CA cert rotation plugin_ca_test.go:122: plugin_ca_test.go:122: STEP 12: Wait until certificates reloaded plugin_ca_test.go:124: SUCCESS: Istiod detected cacerts secret correctly plugin_ca_test.go:132: plugin_ca_test.go:132: STEP 13: Make sure that istiod was not restarted test.go:77: test.go:82: Test completed in 17.64s (excluding cleanup) plugin_ca_test.go:48: plugin_ca_test.go:48: Performing cleanup plugin_ca_test.go:52: Deleting namespaces: [foo] plugin_ca_test.go:52: Creating namespaces: [foo] install.go:49: Deleting namespaces: [cert-manager-operator] install.go:50: Deleting namespaces: [cert-manager] plugin_ca_test.go:48: Cleanup completed in 43.29s --- PASS: TestPluginCaCert (60.93s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/certmanager 186.954s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestCircuitBreaking circuit_breaking_test.go:37: This test checks whether the circuit breaker functions correctly. Check documentation: https://istio.io/latest/docs/tasks/traffic-management/circuit-breaking/ circuit_breaking_test.go:44: circuit_breaking_test.go:44: STEP 1: Apply default SMCP and SMMR manifests circuit_breaking_test.go:44: Wait for condition condition=Ready on smcp istio-system/basic... circuit_breaking_test.go:44: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 circuit_breaking_test.go:44: Wait for condition condition=Ready on smcp istio-system/basic... circuit_breaking_test.go:44: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 circuit_breaking_test.go:44: Wait for condition condition=Ready on smcp istio-system/basic... circuit_breaking_test.go:44: SUCCESS: Condition condition=Ready met by smcp istio-system/basic circuit_breaking_test.go:46: circuit_breaking_test.go:46: STEP 2: Install httpbin and fortio circuit_breaking_test.go:47: Install app "httpbin" in namespace "bookinfo" circuit_breaking_test.go:47: Install app "fortio" in namespace "bookinfo" circuit_breaking_test.go:47: Wait for app bookinfo/httpbin to be ready circuit_breaking_test.go:47: Wait for app bookinfo/fortio to be ready circuit_breaking_test.go:49: circuit_breaking_test.go:49: STEP 3: Configure circuit breaker destination rule circuit_breaking_test.go:52: circuit_breaking_test.go:52: STEP 4: Verify connection with curl: expect 200 OK circuit_breaking_test.go:55: SUCCESS: Got expected 200 OK response from httpbin circuit_breaking_test.go:66: circuit_breaking_test.go:66: STEP 5: Trip the circuit breaker by sending 50 requests to httpbin with 2 connections circuit_breaking_test.go:67: We expect request with response code 503 circuit_breaking_test.go:79: Success rate 200: 60% circuit_breaking_test.go:80: Success rate 503: 40% circuit_breaking_test.go:85: circuit_breaking_test.go:85: STEP 6: Validate the circuit breaker is tripped by checking the istio-proxy log circuit_breaking_test.go:86: Verify istio-proxy pilot-agent stats, expected upstream_rq_pending_overflow value to be more than zero circuit_breaking_test.go:122: SUCCESS: Found Upstream_rq_pending_overflow : 20 test.go:77: test.go:82: Test completed in 28.28s (excluding cleanup) circuit_breaking_test.go:40: circuit_breaking_test.go:40: Performing cleanup circuit_breaking_test.go:41: Deleting namespaces: [bookinfo] circuit_breaking_test.go:41: Creating namespaces: [bookinfo] circuit_breaking_test.go:40: Cleanup completed in 17.49s --- PASS: TestCircuitBreaking (45.77s) === RUN TestFaultInjection fault_injection_test.go:47: fault_injection_test.go:47: STEP 1: Apply default SMCP and SMMR manifests fault_injection_test.go:47: Wait for condition condition=Ready on smcp istio-system/basic... fault_injection_test.go:47: SUCCESS: Condition condition=Ready met by smcp istio-system/basic fault_injection_test.go:49: fault_injection_test.go:49: STEP 2: Install Bookinfo fault_injection_test.go:50: Install app "bookinfo" in namespace "bookinfo" fault_injection_test.go:50: Create Bookinfo Gateway fault_injection_test.go:50: Create Bookinfo Destination Rules (all) fault_injection_test.go:50: Create Bookinfo Deployments fault_injection_test.go:50: Wait for app bookinfo/bookinfo to be ready fault_injection_test.go:52: Logging into bookinfo as "jason" === RUN TestFaultInjection/ratings-fault-delay fault_injection_test.go:60: fault_injection_test.go:60: STEP 1: check if productpage shows 'error fetching product reviews' due to delay injection fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 203ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 1/60 failed. Retrying... fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 181ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 2/60 failed. Retrying... fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 113ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 3/60 failed. Retrying... fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 92ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 4/60 failed. Retrying... fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 149ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 5/60 failed. Retrying... fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 134ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 6/60 failed. Retrying... fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 132ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 7/60 failed. Retrying... fault_injection_test.go:62: FAILURE: expected request duration to be between 4s and 14s, but was 131ms fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 8/60 failed. Retrying... fault_injection_test.go:62: SUCCESS: request completed in 6.02s, which is within the expected range 4s - 14s fault_injection_test.go:62: SUCCESS: productpage shows 'error fetching product reviews', which is expected fault_injection_test.go:61: --- Attempt 9/60 successful; total time: 16.01s subtest.go:23: subtest.go:28: Subtest completed in 16.29s (excluding cleanup) --- PASS: TestFaultInjection/ratings-fault-delay (16.29s) === RUN TestFaultInjection/ratings-fault-abort fault_injection_test.go:77: fault_injection_test.go:77: STEP 1: check if productpage shows ratings service as unavailable due to abort injection fault_injection_test.go:79: SUCCESS: productpage shows 'ratings service is currently unavailable' as expected subtest.go:23: subtest.go:28: Subtest completed in 0.47s (excluding cleanup) --- PASS: TestFaultInjection/ratings-fault-abort (0.47s) test.go:77: test.go:82: Test completed in 30.62s (excluding cleanup) fault_injection_test.go:43: fault_injection_test.go:43: Performing cleanup fault_injection_test.go:44: Deleting namespaces: [bookinfo] fault_injection_test.go:44: Creating namespaces: [bookinfo] fault_injection_test.go:43: Cleanup completed in 12.69s --- PASS: TestFaultInjection (43.30s) === RUN TestRequestRouting request_routing_test.go:37: request_routing_test.go:37: STEP 1: Apply default SMCP and SMMR manifests request_routing_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... request_routing_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic request_routing_test.go:39: request_routing_test.go:39: STEP 2: Install Bookinfo request_routing_test.go:40: Install app "bookinfo" in namespace "bookinfo" request_routing_test.go:40: Create Bookinfo Gateway request_routing_test.go:40: Create Bookinfo Destination Rules (all) request_routing_test.go:40: Create Bookinfo Deployments request_routing_test.go:40: Wait for app bookinfo/bookinfo to be ready request_routing_test.go:43: Logging into bookinfo as "jason" === RUN TestRequestRouting/not-logged-in request_routing_test.go:48: request_routing_test.go:48: STEP 1: get productpage without logging in; expect to get reviews-v1 (5x) request_routing_test.go:51: FAILURE: expected productpage to call reviews-v1, but got an unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_routing_test.go:49: --- Attempt 1/60 failed. Retrying... request_routing_test.go:51: FAILURE: expected productpage to call reviews-v1, but got an unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_routing_test.go:49: --- Attempt 2/60 failed. Retrying... request_routing_test.go:51: FAILURE: expected productpage to call reviews-v1, but got an unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_routing_test.go:49: --- Attempt 3/60 failed. Retrying... request_routing_test.go:51: FAILURE: expected productpage to call reviews-v1, but got an unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_routing_test.go:49: --- Attempt 4/60 failed. Retrying... request_routing_test.go:51: FAILURE: expected productpage to call reviews-v1, but got an unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_routing_test.go:49: --- Attempt 5/60 failed. Retrying... request_routing_test.go:51: FAILURE: expected productpage to call reviews-v1, but got an unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_routing_test.go:49: --- Attempt 6/60 failed. Retrying... request_routing_test.go:51: SUCCESS: productpage called reviews-v1 request_routing_test.go:51: SUCCESS: productpage called reviews-v1 request_routing_test.go:51: SUCCESS: productpage called reviews-v1 request_routing_test.go:51: SUCCESS: productpage called reviews-v1 request_routing_test.go:51: SUCCESS: productpage called reviews-v1 request_routing_test.go:49: --- Attempt 7/60 successful; total time: 7.41s subtest.go:23: subtest.go:28: Subtest completed in 7.74s (excluding cleanup) --- PASS: TestRequestRouting/not-logged-in (7.74s) === RUN TestRequestRouting/logged-in request_routing_test.go:65: request_routing_test.go:65: STEP 1: get productpage as logged-in user; expect to get reviews-v2 (5x) request_routing_test.go:68: FAILURE: expected productpage to call reviews-v2, but got an unexpected response; expected the response to match file "productpage-test-user-v2.html", but it matched "productpage-test-user-v1.html" request_routing_test.go:66: --- Attempt 1/60 failed. Retrying... request_routing_test.go:68: SUCCESS: productpage called reviews-v2 request_routing_test.go:68: SUCCESS: productpage called reviews-v2 request_routing_test.go:68: SUCCESS: productpage called reviews-v2 request_routing_test.go:68: SUCCESS: productpage called reviews-v2 request_routing_test.go:68: SUCCESS: productpage called reviews-v2 request_routing_test.go:66: --- Attempt 2/60 successful; total time: 1.56s subtest.go:23: subtest.go:28: Subtest completed in 1.83s (excluding cleanup) --- PASS: TestRequestRouting/logged-in (1.83s) test.go:77: test.go:82: Test completed in 21.39s (excluding cleanup) request_routing_test.go:33: request_routing_test.go:33: Performing cleanup request_routing_test.go:34: Deleting namespaces: [bookinfo] request_routing_test.go:34: Creating namespaces: [bookinfo] request_routing_test.go:33: Cleanup completed in 12.22s --- PASS: TestRequestRouting (33.61s) === RUN TestRequestTimeouts request_timeouts_test.go:42: request_timeouts_test.go:42: STEP 1: Apply default SMCP and SMMR manifests request_timeouts_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... request_timeouts_test.go:42: SUCCESS: Condition condition=Ready met by smcp istio-system/basic request_timeouts_test.go:44: request_timeouts_test.go:44: STEP 2: Install Bookinfo request_timeouts_test.go:45: Install app "bookinfo" in namespace "bookinfo" request_timeouts_test.go:45: Create Bookinfo Gateway request_timeouts_test.go:45: Create Bookinfo Destination Rules (all) request_timeouts_test.go:45: Create Bookinfo Deployments request_timeouts_test.go:45: Wait for app bookinfo/bookinfo to be ready request_timeouts_test.go:51: request_timeouts_test.go:51: STEP 3: make sure there is no timeout before applying delay and timeout in VirtualServices request_timeouts_test.go:53: FAILURE: unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_timeouts_test.go:52: --- Attempt 1/60 failed. Retrying... request_timeouts_test.go:53: FAILURE: unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_timeouts_test.go:52: --- Attempt 2/60 failed. Retrying... request_timeouts_test.go:53: FAILURE: unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_timeouts_test.go:52: --- Attempt 3/60 failed. Retrying... request_timeouts_test.go:53: FAILURE: unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_timeouts_test.go:52: --- Attempt 4/60 failed. Retrying... request_timeouts_test.go:53: FAILURE: unexpected response; expected the response to match file "productpage-normal-user-v1.html", but it matched "productpage-review-timeout.html" request_timeouts_test.go:52: --- Attempt 5/60 failed. Retrying... request_timeouts_test.go:53: SUCCESS: received normal productpage response request_timeouts_test.go:52: --- Attempt 6/60 successful; total time: 6.81s request_timeouts_test.go:62: request_timeouts_test.go:62: STEP 4: apply delay and timeout in VirtualServices request_timeouts_test.go:65: request_timeouts_test.go:65: STEP 5: check if productpage shows 'error fetching product reviews' due to delay and timeout injection request_timeouts_test.go:68: FAILURE: expected productpage to show 'error fetching product reviews', but got a different response; expected the response to match file "productpage-review-timeout.html", but it matched "productpage-normal-user-v1.html" request_timeouts_test.go:66: --- Attempt 1/60 failed. Retrying... request_timeouts_test.go:68: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:68: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:68: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:68: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:68: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:68: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:66: --- Attempt 2/60 successful; total time: 7.13s test.go:77: test.go:82: Test completed in 27.07s (excluding cleanup) request_timeouts_test.go:38: request_timeouts_test.go:38: Performing cleanup request_timeouts_test.go:39: Deleting namespaces: [bookinfo] request_timeouts_test.go:39: Creating namespaces: [bookinfo] request_timeouts_test.go:38: Cleanup completed in 12.15s --- PASS: TestRequestTimeouts (39.22s) === RUN TestMirroring traffic_mirroring_test.go:38: traffic_mirroring_test.go:38: STEP 1: Apply default SMCP and SMMR manifests traffic_mirroring_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... traffic_mirroring_test.go:38: SUCCESS: Condition condition=Ready met by smcp istio-system/basic traffic_mirroring_test.go:40: traffic_mirroring_test.go:40: STEP 2: Install httpbin-v1, httpbin-v2, and sleep traffic_mirroring_test.go:41: Install app "httpbin-v1" in namespace "bookinfo" traffic_mirroring_test.go:41: Install app "httpbin-v2" in namespace "bookinfo" traffic_mirroring_test.go:41: Install app "sleep" in namespace "bookinfo" traffic_mirroring_test.go:41: Wait for app bookinfo/httpbin-v1 to be ready traffic_mirroring_test.go:41: Wait for app bookinfo/httpbin-v2 to be ready traffic_mirroring_test.go:41: Wait for app bookinfo/sleep to be ready === RUN TestMirroring/no_mirroring traffic_mirroring_test.go:49: traffic_mirroring_test.go:49: STEP 1: sending HTTP request from sleep to httpbin-v1, not expecting mirroring to v2 traffic_mirroring_test.go:58: SUCCESS: request received by httpbin-v1 traffic_mirroring_test.go:66: SUCCESS: request not mirrored to httpbin-v2 subtest.go:23: subtest.go:28: Subtest completed in 0.88s (excluding cleanup) --- PASS: TestMirroring/no_mirroring (0.88s) === RUN TestMirroring/mirroring_to_httpbin-v2 traffic_mirroring_test.go:79: traffic_mirroring_test.go:79: STEP 1: sending HTTP request from sleep to httpbin-v1, expecting mirroring to v2 traffic_mirroring_test.go:88: SUCCESS: request received by httpbin-v1 traffic_mirroring_test.go:96: SUCCESS: request mirrored to httpbin-v2 subtest.go:23: subtest.go:28: Subtest completed in 0.89s (excluding cleanup) --- PASS: TestMirroring/mirroring_to_httpbin-v2 (0.89s) test.go:77: test.go:82: Test completed in 13.68s (excluding cleanup) traffic_mirroring_test.go:34: traffic_mirroring_test.go:34: Performing cleanup traffic_mirroring_test.go:35: Deleting namespaces: [bookinfo] traffic_mirroring_test.go:35: Creating namespaces: [bookinfo] traffic_mirroring_test.go:34: Cleanup completed in 17.57s --- PASS: TestMirroring (31.25s) === RUN TestTrafficShifting traffic_shifting_test.go:41: traffic_shifting_test.go:41: STEP 1: Apply default SMCP and SMMR manifests traffic_shifting_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... traffic_shifting_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic traffic_shifting_test.go:43: traffic_shifting_test.go:43: STEP 2: Install Bookinfo traffic_shifting_test.go:44: Install app "bookinfo" in namespace "bookinfo" traffic_shifting_test.go:44: Create Bookinfo Gateway traffic_shifting_test.go:44: Create Bookinfo Destination Rules (all) traffic_shifting_test.go:44: Create Bookinfo Deployments traffic_shifting_test.go:44: Wait for app bookinfo/bookinfo to be ready === RUN TestTrafficShifting/50_percent_to_v3 traffic_shifting_test.go:50: traffic_shifting_test.go:50: STEP 1: configure VirtualService to split traffic 50% to v1 and 50% to v3 traffic_shifting_test.go:53: traffic_shifting_test.go:53: STEP 2: Make 100 requests and check if v1 and v3 get 50% of requests each (tolerance: 20%) traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:105: FAILURE: Response did not match any expected value, but matched file "productpage-review-timeout.html" traffic_shifting_test.go:54: --- Attempt 1/60 failed. Retrying... traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:105: FAILURE: Response did not match any expected value, but matched file "productpage-review-timeout.html" traffic_shifting_test.go:54: --- Attempt 2/60 failed. Retrying... traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:105: FAILURE: Response did not match any expected value, but matched file "productpage-review-timeout.html" traffic_shifting_test.go:54: --- Attempt 3/60 failed. Retrying... traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:105: FAILURE: Response did not match any expected value, but matched file "productpage-review-timeout.html" traffic_shifting_test.go:54: --- Attempt 4/60 failed. Retrying... traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:105: FAILURE: Response did not match any expected value, but matched file "productpage-review-timeout.html" traffic_shifting_test.go:54: --- Attempt 5/60 failed. Retrying... traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:116: SUCCESS: 43/100 responses matched productpage-normal-user-v3.html (actual rate 0.430000, expected 0.500000, tolerance 0.200000) traffic_shifting_test.go:116: SUCCESS: 57/100 responses matched productpage-normal-user-v1.html (actual rate 0.570000, expected 0.500000, tolerance 0.200000) traffic_shifting_test.go:54: --- Attempt 6/60 successful; total time: 11.09s subtest.go:23: subtest.go:28: Subtest completed in 11.43s (excluding cleanup) --- PASS: TestTrafficShifting/50_percent_to_v3 (11.43s) === RUN TestTrafficShifting/100_percent_to_v3 traffic_shifting_test.go:64: traffic_shifting_test.go:64: STEP 1: configure VirtualService to send all traffic to v3 traffic_shifting_test.go:67: traffic_shifting_test.go:67: STEP 2: Make 100 requests and check if all of them go to v3 (tolerance: 0%) traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:118: FAILURE: 1/100 responses matched productpage-normal-user-v1.html (actual rate 0.010000, expected 0.000000, tolerance 0.000000) traffic_shifting_test.go:118: FAILURE: 99/100 responses matched productpage-normal-user-v3.html (actual rate 0.990000, expected 1.000000, tolerance 0.000000) traffic_shifting_test.go:68: --- Attempt 1/60 failed. Retrying... traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:82: SUCCESS: received expected status code 200 traffic_shifting_test.go:116: SUCCESS: 100/100 responses matched productpage-normal-user-v3.html (actual rate 1.000000, expected 1.000000, tolerance 0.000000) traffic_shifting_test.go:68: --- Attempt 2/60 successful; total time: 10.10s subtest.go:23: subtest.go:28: Subtest completed in 10.41s (excluding cleanup) --- PASS: TestTrafficShifting/100_percent_to_v3 (10.41s) test.go:77: test.go:82: Test completed in 34.94s (excluding cleanup) traffic_shifting_test.go:37: traffic_shifting_test.go:37: Performing cleanup traffic_shifting_test.go:38: Deleting namespaces: [bookinfo] traffic_shifting_test.go:38: Creating namespaces: [bookinfo] traffic_shifting_test.go:37: Cleanup completed in 12.30s --- PASS: TestTrafficShifting (47.24s) === RUN TestTcpTrafficShifting traffic_tcp_shifting_test.go:41: This test validates traffic shifting for TCP traffic. traffic_tcp_shifting_test.go:42: Doc reference: https://istio.io/v1.14/docs/tasks/traffic-management/tcp-traffic-shifting/ traffic_tcp_shifting_test.go:44: traffic_tcp_shifting_test.go:44: STEP 1: Apply default SMCP and SMMR manifests traffic_tcp_shifting_test.go:44: Wait for condition condition=Ready on smcp istio-system/basic... traffic_tcp_shifting_test.go:44: SUCCESS: Condition condition=Ready met by smcp istio-system/basic traffic_tcp_shifting_test.go:46: traffic_tcp_shifting_test.go:46: STEP 2: Install sleep, echoV1 and echoV2 traffic_tcp_shifting_test.go:47: Install app "sleep" in namespace "foo" traffic_tcp_shifting_test.go:47: Install app "echo-v1" in namespace "foo" traffic_tcp_shifting_test.go:47: Install app "echo-v2" in namespace "foo" traffic_tcp_shifting_test.go:47: Wait for app foo/sleep to be ready traffic_tcp_shifting_test.go:47: Wait for app foo/echo-v1 to be ready traffic_tcp_shifting_test.go:47: Wait for app foo/echo-v2 to be ready === RUN TestTcpTrafficShifting/tcp_shift_100_percent_to_v1 traffic_tcp_shifting_test.go:54: traffic_tcp_shifting_test.go:54: STEP 1: Shifting all TCP traffic to v1 traffic_tcp_shifting_test.go:57: traffic_tcp_shifting_test.go:57: STEP 2: make 20 requests and checking if all of them go to v1 (tolerance: 0%) traffic_tcp_shifting_test.go:114: SUCCESS: 20/20 responses matched one (actual rate 1.000000, expected 1.000000, tolerance 0.000000) subtest.go:23: subtest.go:28: Subtest completed in 0.58s (excluding cleanup) traffic_tcp_shifting_test.go:50: traffic_tcp_shifting_test.go:50: Performing cleanup traffic_tcp_shifting_test.go:50: Cleanup completed in 0.09s --- PASS: TestTcpTrafficShifting/tcp_shift_100_percent_to_v1 (0.67s) === RUN TestTcpTrafficShifting/tcp_shift_20_percent_to_v2 traffic_tcp_shifting_test.go:72: traffic_tcp_shifting_test.go:72: STEP 1: Shifting 20 percent TCP traffic to v2 traffic_tcp_shifting_test.go:75: traffic_tcp_shifting_test.go:75: STEP 2: make 100 requests and checking if 20 percent of them go to v2 (tolerance: 10%) traffic_tcp_shifting_test.go:114: SUCCESS: 17/100 responses matched two (actual rate 0.170000, expected 0.200000, tolerance 0.100000) traffic_tcp_shifting_test.go:114: SUCCESS: 83/100 responses matched one (actual rate 0.830000, expected 0.800000, tolerance 0.100000) subtest.go:23: subtest.go:28: Subtest completed in 0.70s (excluding cleanup) traffic_tcp_shifting_test.go:68: traffic_tcp_shifting_test.go:68: Performing cleanup traffic_tcp_shifting_test.go:68: Cleanup completed in 0.08s --- PASS: TestTcpTrafficShifting/tcp_shift_20_percent_to_v2 (0.79s) test.go:77: test.go:82: Test completed in 12.82s (excluding cleanup) traffic_tcp_shifting_test.go:37: traffic_tcp_shifting_test.go:37: Performing cleanup traffic_tcp_shifting_test.go:37: Cleanup completed in 0.35s --- PASS: TestTcpTrafficShifting (13.17s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/traffic 253.854s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAccessExternalServices access_external_services_test.go:43: This test validates accesses to external services access_external_services_test.go:45: access_external_services_test.go:45: STEP 1: Apply default SMCP and SMMR manifests access_external_services_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... access_external_services_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic access_external_services_test.go:47: access_external_services_test.go:47: STEP 2: Install sleep into bookinfo access_external_services_test.go:49: Install app "sleep" in namespace "bookinfo" access_external_services_test.go:49: Wait for app bookinfo/sleep to be ready access_external_services_test.go:51: access_external_services_test.go:51: STEP 3: Install httpbin in mesh-external access_external_services_test.go:53: Install app "httpbin" in namespace "mesh-external" access_external_services_test.go:53: Wait for app mesh-external/httpbin to be ready access_external_services_test.go:55: access_external_services_test.go:55: STEP 4: Make request to external httpbin from sleep egress_common.go:24: SUCCESS: Got expected 200 OK from http://httpbin.mesh-external:8000/headers access_external_services_test.go:59: access_external_services_test.go:59: STEP 5: Make sure that external httpbin was not discovered by Istio istioctl.go:12: SUCCESS: Httpbin was not discovered access_external_services_test.go:67: access_external_services_test.go:67: STEP 6: Patch outbound traffic policy to registry only - see https://istio.io/latest/docs/tasks/traffic-management/egress/egress-control/#envoy-passthrough-to-external-services access_external_services_test.go:81: access_external_services_test.go:81: STEP 7: Make request to external httpbin from sleep again, and expect it denied egress_common.go:31: FAILURE: Expect request to failed, but got a response; expected to find the string 'CURL_FAILED' in the output, but it wasn't found egress_common.go:31: --- Attempt 1/60 failed. Retrying... egress_common.go:31: SUCCESS: Got a failure message as expected egress_common.go:31: --- Attempt 2/60 successful; total time: 1.49s === RUN TestAccessExternalServices/allow_request_to_external_httpbin_after_applying_ServiceEntry access_external_services_test.go:89: access_external_services_test.go:89: STEP 1: Apply a ServiceEntry for external httpbin access_external_services_test.go:92: access_external_services_test.go:92: STEP 2: Send a request to external httpbin egress_common.go:24: SUCCESS: Got expected 200 OK from http://httpbin.mesh-external:8000/headers subtest.go:23: subtest.go:28: Subtest completed in 0.52s (excluding cleanup) access_external_services_test.go:85: access_external_services_test.go:85: Performing cleanup access_external_services_test.go:85: Cleanup completed in 0.06s --- PASS: TestAccessExternalServices/allow_request_to_external_httpbin_after_applying_ServiceEntry (0.58s) test.go:77: test.go:82: Test completed in 14.95s (excluding cleanup) access_external_services_test.go:35: access_external_services_test.go:35: Performing cleanup access_external_services_test.go:35: Cleanup completed in 0.27s --- PASS: TestAccessExternalServices (15.22s) === RUN TestEgressGateways egress_gateways_test.go:33: egress_gateways_test.go:33: STEP 1: Apply default SMCP and SMMR manifests egress_gateways_test.go:33: Wait for condition condition=Ready on smcp istio-system/basic... egress_gateways_test.go:33: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_gateways_test.go:35: egress_gateways_test.go:35: STEP 2: Install sleep pod egress_gateways_test.go:37: Install app "sleep" in namespace "bookinfo" egress_gateways_test.go:37: Wait for app bookinfo/sleep to be ready === RUN TestEgressGateways/HTTP egress_gateways_test.go:40: egress_gateways_test.go:40: STEP 1: Install external httpbin egress_gateways_test.go:42: Install app "httpbin" in namespace "mesh-external" egress_gateways_test.go:42: Wait for app mesh-external/httpbin to be ready egress_gateways_test.go:44: egress_gateways_test.go:44: STEP 2: Apply a ServiceEntry for external httpbin egress_gateways_test.go:50: egress_gateways_test.go:50: STEP 3: Apply a gateway and virtual service for external httpbin egress_common.go:24: SUCCESS: Got expected 200 OK from http://httpbin.mesh-external:8000/headers subtest.go:23: subtest.go:28: Subtest completed in 1.22s (excluding cleanup) egress_gateways_test.go:52: egress_gateways_test.go:52: Performing cleanup egress_gateways_test.go:52: Cleanup completed in 0.08s egress_gateways_test.go:46: egress_gateways_test.go:46: Performing cleanup egress_gateways_test.go:46: Cleanup completed in 0.08s --- PASS: TestEgressGateways/HTTP (1.38s) === RUN TestEgressGateways/HTTPS egress_gateways_test.go:60: egress_gateways_test.go:60: STEP 1: Install external nginx egress_gateways_test.go:61: Install app "nginx" in namespace "mesh-external" egress_gateways_test.go:61: Wait for app mesh-external/nginx to be ready egress_gateways_test.go:63: egress_gateways_test.go:63: STEP 2: Create ServiceEntry for external nginx, port 80 and 443 egress_gateways_test.go:69: egress_gateways_test.go:69: STEP 3: Create a TLS ServiceEntry to external nginx egress_gateways_test.go:75: egress_gateways_test.go:75: STEP 4: Create a https Gateway to external nginx egress_gateways_test.go:81: Send HTTPS request to external nginx egress_common.go:39: SUCCESS: Got expected 200 OK from curl -sSL --insecure -o /dev/null -w "%{http_code}" https://my-nginx.mesh-external.svc.cluster.local 2>/dev/null || echo CURL_FAILED subtest.go:23: subtest.go:28: Subtest completed in 5.37s (excluding cleanup) egress_gateways_test.go:77: egress_gateways_test.go:77: Performing cleanup egress_gateways_test.go:77: Cleanup completed in 0.08s egress_gateways_test.go:71: egress_gateways_test.go:71: Performing cleanup egress_gateways_test.go:71: Cleanup completed in 0.06s egress_gateways_test.go:65: egress_gateways_test.go:65: Performing cleanup egress_gateways_test.go:65: Cleanup completed in 0.07s --- PASS: TestEgressGateways/HTTPS (5.59s) test.go:77: test.go:82: Test completed in 18.29s (excluding cleanup) egress_gateways_test.go:29: egress_gateways_test.go:29: Performing cleanup egress_gateways_test.go:30: Deleting namespaces: [bookinfo] egress_gateways_test.go:30: Creating namespaces: [bookinfo] egress_gateways_test.go:29: Cleanup completed in 11.75s --- PASS: TestEgressGateways (30.04s) === RUN TestTLSOrigination egress_gateways_tls_file_mount_test.go:33: This test verifies that TLS origination works in 2 scenarios: egress_gateways_tls_file_mount_test.go:34: 1) Egress gateway TLS Origination egress_gateways_tls_file_mount_test.go:35: 2) MTLS Origination with file mount (certificates mounted in egress gateway pod) egress_gateways_tls_file_mount_test.go:41: egress_gateways_tls_file_mount_test.go:41: STEP 1: Apply default SMCP and SMMR manifests egress_gateways_tls_file_mount_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... egress_gateways_tls_file_mount_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_gateways_tls_file_mount_test.go:43: egress_gateways_tls_file_mount_test.go:43: STEP 2: Install sleep pod egress_gateways_tls_file_mount_test.go:44: Install app "sleep" in namespace "bookinfo" egress_gateways_tls_file_mount_test.go:44: Wait for app bookinfo/sleep to be ready === RUN TestTLSOrigination/Egress_Gateway_without_file_mount egress_gateways_tls_file_mount_test.go:47: Perform TLS origination with an egress gateway egress_gateways_tls_file_mount_test.go:49: egress_gateways_tls_file_mount_test.go:49: STEP 1: Install external nginx egress_gateways_tls_file_mount_test.go:50: Install app "nginx" in namespace "mesh-external" egress_gateways_tls_file_mount_test.go:50: Wait for app mesh-external/nginx to be ready egress_gateways_tls_file_mount_test.go:52: egress_gateways_tls_file_mount_test.go:52: STEP 2: Make sure that mesh external namespace is not discovered by Istio - it would happen if mesh-external namespaces was added to the SMMR istioctl.go:12: SUCCESS: mesh-external namespace was not discovered egress_gateways_tls_file_mount_test.go:60: egress_gateways_tls_file_mount_test.go:60: STEP 3: Create ServiceEntry for external nginx, port 80 and 443 egress_gateways_tls_file_mount_test.go:66: egress_gateways_tls_file_mount_test.go:66: STEP 4: Create a Gateway, DestinationRule, and VirtualService to route requests to external nginx through the egress gateway egress_gateways_tls_file_mount_test.go:74: egress_gateways_tls_file_mount_test.go:74: STEP 5: Verify that request to external nginx is routed through the egress gateway (response 200 indicates that the TLS origination is done by the egress gateway) egress_gateways_tls_file_mount_test.go:75: SUCCESS: Get expected response: Welcome to nginx subtest.go:23: subtest.go:28: Subtest completed in 2.15s (excluding cleanup) egress_gateways_tls_file_mount_test.go:69: egress_gateways_tls_file_mount_test.go:69: Performing cleanup egress_gateways_tls_file_mount_test.go:69: Cleanup completed in 0.14s egress_gateways_tls_file_mount_test.go:62: egress_gateways_tls_file_mount_test.go:62: Performing cleanup egress_gateways_tls_file_mount_test.go:62: Cleanup completed in 0.06s --- PASS: TestTLSOrigination/Egress_Gateway_without_file_mount (2.35s) === RUN TestTLSOrigination/mTLS_with_file_mount egress_gateways_tls_file_mount_test.go:84: Perform mTLS origination with an egress gateway egress_gateways_tls_file_mount_test.go:98: egress_gateways_tls_file_mount_test.go:98: STEP 1: Deploy nginx mTLS server and create secrets in the mesh namespace egress_gateways_tls_file_mount_test.go:103: Install app "nginx" in namespace "mesh-external" egress_gateways_tls_file_mount_test.go:105: egress_gateways_tls_file_mount_test.go:105: STEP 2: Patch egress gateway with File Mount configuration egress_gateways_tls_file_mount_test.go:108: egress_gateways_tls_file_mount_test.go:108: STEP 3: Configure mTLS origination for egress traffic egress_gateways_tls_file_mount_test.go:112: egress_gateways_tls_file_mount_test.go:112: STEP 4: Wait for egress gateway and nginx to be ready egress_gateways_tls_file_mount_test.go:114: Wait for app mesh-external/nginx to be ready egress_gateways_tls_file_mount_test.go:116: egress_gateways_tls_file_mount_test.go:116: STEP 5: Verify NGINX server egress_gateways_tls_file_mount_test.go:117: SUCCESS: Get expected response: Welcome to nginx subtest.go:23: subtest.go:28: Subtest completed in 2.79s (excluding cleanup) egress_gateways_tls_file_mount_test.go:85: egress_gateways_tls_file_mount_test.go:85: Performing cleanup egress_gateways_tls_file_mount_test.go:95: SUCCESS: Pod istio-ingressgateway-66687bcf5c-28pqv is being deleted egress_gateways_tls_file_mount_test.go:85: Cleanup completed in 6.87s --- PASS: TestTLSOrigination/mTLS_with_file_mount (9.66s) test.go:77: test.go:82: Test completed in 22.44s (excluding cleanup) egress_gateways_tls_file_mount_test.go:37: egress_gateways_tls_file_mount_test.go:37: Performing cleanup egress_gateways_tls_file_mount_test.go:37: Cleanup completed in 0.18s --- PASS: TestTLSOrigination (22.62s) === RUN TestTLSOriginationSDS egress_gateways_tls_sds_test.go:37: Perform mTLS origination with an egress gateway egress_gateways_tls_sds_test.go:38: egress_gateways_tls_sds_test.go:38: STEP 1: Apply default SMCP and SMMR manifests egress_gateways_tls_sds_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... egress_gateways_tls_sds_test.go:38: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_gateways_tls_sds_test.go:40: egress_gateways_tls_sds_test.go:40: STEP 2: Install sleep pod egress_gateways_tls_sds_test.go:42: Install app "sleep" in namespace "bookinfo" egress_gateways_tls_sds_test.go:42: Wait for app bookinfo/sleep to be ready egress_gateways_tls_sds_test.go:44: egress_gateways_tls_sds_test.go:44: STEP 3: Deploy nginx mTLS server and create secrets in the mesh namespace egress_gateways_tls_sds_test.go:45: Install app "nginx" in namespace "mesh-external" egress_gateways_tls_sds_test.go:45: Wait for app mesh-external/nginx to be ready egress_gateways_tls_sds_test.go:53: Send HTTP request to external nginx to verify mTLS origination egress_common.go:24: SUCCESS: Got expected 200 OK from http://my-nginx.mesh-external.svc.cluster.local test.go:77: test.go:82: Test completed in 14.37s (excluding cleanup) egress_gateways_tls_sds_test.go:29: egress_gateways_tls_sds_test.go:29: Performing cleanup egress_gateways_tls_sds_test.go:30: Deleting namespaces: [bookinfo] egress_gateways_tls_sds_test.go:30: Creating namespaces: [bookinfo] egress_gateways_tls_sds_test.go:31: Deleting namespaces: [mesh-external] egress_gateways_tls_sds_test.go:31: Creating namespaces: [mesh-external] egress_gateways_tls_sds_test.go:29: Cleanup completed in 24.47s --- PASS: TestTLSOriginationSDS (38.84s) === RUN TestEgressTLSOrigination egress_tls_origination_test.go:35: egress_tls_origination_test.go:35: STEP 1: Apply default SMCP and SMMR manifests egress_tls_origination_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... egress_tls_origination_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_tls_origination_test.go:37: egress_tls_origination_test.go:37: STEP 2: Install sleep pod egress_tls_origination_test.go:38: Install app "sleep" in namespace "bookinfo" egress_tls_origination_test.go:38: Wait for app bookinfo/sleep to be ready === RUN TestEgressTLSOrigination/TrafficManagement_egress_tls_origination egress_tls_origination_test.go:41: TLS origination for egress traffic egress_tls_origination_test.go:49: Install app "nginx" in namespace "mesh-external" egress_tls_origination_test.go:49: Wait for app mesh-external/nginx to be ready egress_common.go:24: SUCCESS: Got expected 200 OK from http://my-nginx.mesh-external.svc.cluster.local subtest.go:23: subtest.go:28: Subtest completed in 6.97s (excluding cleanup) egress_tls_origination_test.go:42: egress_tls_origination_test.go:42: Performing cleanup egress_tls_origination_test.go:42: Cleanup completed in 0.57s --- PASS: TestEgressTLSOrigination/TrafficManagement_egress_tls_origination (7.54s) test.go:77: test.go:82: Test completed in 18.63s (excluding cleanup) egress_tls_origination_test.go:30: egress_tls_origination_test.go:30: Performing cleanup egress_tls_origination_test.go:31: Deleting namespaces: [mesh-external] egress_tls_origination_test.go:31: Creating namespaces: [mesh-external] egress_tls_origination_test.go:30: Cleanup completed in 6.26s --- PASS: TestEgressTLSOrigination (24.89s) === RUN TestEgressWildcard egress_wildcard_hosts_test.go:31: This test checks if the wildcard in the ServiceEntry and Gateway works as expected for Egress traffic. egress_wildcard_hosts_test.go:35: egress_wildcard_hosts_test.go:35: STEP 1: Apply default SMCP and SMMR manifests egress_wildcard_hosts_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... egress_wildcard_hosts_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_wildcard_hosts_test.go:37: egress_wildcard_hosts_test.go:37: STEP 2: Install the sleep pod egress_wildcard_hosts_test.go:38: Install app "sleep" in namespace "bookinfo" egress_wildcard_hosts_test.go:38: Wait for app bookinfo/sleep to be ready === RUN TestEgressWildcard/ServiceEntry egress_wildcard_hosts_test.go:44: egress_wildcard_hosts_test.go:44: STEP 1: Configure ServiceEntry with wildcard host *.wikipedia.org egress_wildcard_hosts_test.go:66: egress_wildcard_hosts_test.go:66: STEP 2: Check external request to en.wikipedia.org and de.wikipedia.org egress_wildcard_hosts_test.go:68: SUCCESS: Received the correct response from en.wikipedia.org egress_wildcard_hosts_test.go:77: SUCCESS: Received the correct response from de.wikipedia.org subtest.go:23: subtest.go:28: Subtest completed in 1.04s (excluding cleanup) egress_wildcard_hosts_test.go:46: egress_wildcard_hosts_test.go:46: Performing cleanup egress_wildcard_hosts_test.go:46: Cleanup completed in 0.06s --- PASS: TestEgressWildcard/ServiceEntry (1.11s) === RUN TestEgressWildcard/Gateway egress_wildcard_hosts_test.go:54: egress_wildcard_hosts_test.go:54: STEP 1: Configure egress Gateway with wildcard host *.wikipedia.org egress_wildcard_hosts_test.go:66: egress_wildcard_hosts_test.go:66: STEP 2: Check external request to en.wikipedia.org and de.wikipedia.org egress_wildcard_hosts_test.go:68: SUCCESS: Received the correct response from en.wikipedia.org egress_wildcard_hosts_test.go:77: SUCCESS: Received the correct response from de.wikipedia.org subtest.go:23: subtest.go:28: Subtest completed in 1.02s (excluding cleanup) egress_wildcard_hosts_test.go:56: egress_wildcard_hosts_test.go:56: Performing cleanup egress_wildcard_hosts_test.go:56: Cleanup completed in 0.08s --- PASS: TestEgressWildcard/Gateway (1.11s) test.go:77: test.go:82: Test completed in 13.31s (excluding cleanup) egress_wildcard_hosts_test.go:39: egress_wildcard_hosts_test.go:39: Performing cleanup egress_wildcard_hosts_test.go:39: Cleanup completed in 0.17s --- PASS: TestEgressWildcard (13.48s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/traffic/egress 145.379s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestGatewayApi gatewayapi_test.go:28: gatewayapi_test.go:28: STEP 1: Apply default SMCP and SMMR manifests gatewayapi_test.go:28: Wait for condition condition=Ready on smcp istio-system/basic... gatewayapi_test.go:28: SUCCESS: Condition condition=Ready met by smcp istio-system/basic gatewayapi_test.go:30: gatewayapi_test.go:30: STEP 2: Install Gateway API CRD's gatewayapi_test.go:33: Creating namespaces: [foo] === RUN TestGatewayApi/Deploy_the_Kubernetes_Gateway_API gatewayapi_test.go:42: gatewayapi_test.go:42: STEP 1: Install httpbin gatewayapi_test.go:43: Install app "httpbin" in namespace "foo" gatewayapi_test.go:43: Wait for app foo/httpbin to be ready gatewayapi_test.go:45: gatewayapi_test.go:45: STEP 2: Deploy the Gateway SMCP gatewayapi_test.go:78: gatewayapi_test.go:78: STEP 3: Deploy the Gateway API configuration including a single exposed route (i.e., /get) gatewayapi_test.go:84: gatewayapi_test.go:84: STEP 4: Wait for Gateway to be ready gatewayapi_test.go:85: Wait for condition condition=Ready on Gateway foo/gateway... gatewayapi_test.go:85: SUCCESS: Condition condition=Ready met by Gateway foo/gateway gatewayapi_test.go:87: gatewayapi_test.go:87: STEP 5: Verfiy the GatewayApi access the httpbin service using curl gatewayapi_test.go:89: SUCCESS: Access the httpbin service with GatewayApi subtest.go:23: subtest.go:28: Subtest completed in 9.15s (excluding cleanup) gatewayapi_test.go:80: gatewayapi_test.go:80: Performing cleanup gatewayapi_test.go:80: Cleanup completed in 0.23s gatewayapi_test.go:71: gatewayapi_test.go:71: Performing cleanup gatewayapi_test.go:71: Cleanup completed in 0.10s gatewayapi_test.go:37: gatewayapi_test.go:37: Performing cleanup gatewayapi_test.go:38: Deleting namespaces: [istio-system] gatewayapi_test.go:38: Creating namespaces: [istio-system] gatewayapi_test.go:39: Deleting namespaces: [foo] gatewayapi_test.go:39: Creating namespaces: [foo] gatewayapi_test.go:37: Cleanup completed in 35.01s --- PASS: TestGatewayApi/Deploy_the_Kubernetes_Gateway_API (44.49s) === RUN TestGatewayApi/Deploy_the_Gateway-Controller_Profile gatewayapi_test.go:109: gatewayapi_test.go:109: STEP 1: Install httpbin gatewayapi_test.go:110: Install app "httpbin" in namespace "foo" gatewayapi_test.go:110: Wait for app foo/httpbin to be ready gatewayapi_test.go:112: gatewayapi_test.go:112: STEP 2: Deploy SMCP with the profile gatewayapi_test.go:117: Wait for condition condition=Ready on smcp istio-system/basic... gatewayapi_test.go:117: SUCCESS: Condition condition=Ready met by smcp istio-system/basic gatewayapi_test.go:119: gatewayapi_test.go:119: STEP 3: delete default SMMR and create custom SMMR gatewayapi_test.go:124: gatewayapi_test.go:124: STEP 4: Deploy the Gateway API configuration including a single exposed route (i.e., /get) gatewayapi_test.go:130: gatewayapi_test.go:130: STEP 5: Wait for Gateway to be ready gatewayapi_test.go:131: Wait for condition condition=Ready on Gateway foo/gateway... gatewayapi_test.go:131: SUCCESS: Condition condition=Ready met by Gateway foo/gateway gatewayapi_test.go:133: gatewayapi_test.go:133: STEP 6: Verify the Gateway-Controller Profile access the httpbin service using curl gatewayapi_test.go:135: SUCCESS: Access the httpbin service with GatewayApi subtest.go:23: subtest.go:28: Subtest completed in 8.49s (excluding cleanup) gatewayapi_test.go:126: gatewayapi_test.go:126: Performing cleanup gatewayapi_test.go:126: Cleanup completed in 0.08s gatewayapi_test.go:104: gatewayapi_test.go:104: Performing cleanup gatewayapi_test.go:105: Deleting namespaces: [istio-system] gatewayapi_test.go:105: Creating namespaces: [istio-system] gatewayapi_test.go:106: Deleting namespaces: [foo] gatewayapi_test.go:106: Creating namespaces: [foo] gatewayapi_test.go:104: Cleanup completed in 40.44s --- PASS: TestGatewayApi/Deploy_the_Gateway-Controller_Profile (49.01s) test.go:77: test.go:82: Test completed in 103.84s (excluding cleanup) --- PASS: TestGatewayApi (103.84s) === RUN TestIngressGateways ingress_gateways_test.go:42: ingress_gateways_test.go:42: STEP 1: Apply default SMCP and SMMR manifests ingress_gateways_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... ingress_gateways_test.go:42: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 ingress_gateways_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... ingress_gateways_test.go:42: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 ingress_gateways_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... ingress_gateways_test.go:42: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ingress_gateways_test.go:44: ingress_gateways_test.go:44: STEP 2: Install httpbin ingress_gateways_test.go:45: Install app "httpbin" in namespace "bookinfo" ingress_gateways_test.go:45: Wait for app bookinfo/httpbin to be ready === RUN TestIngressGateways/TrafficManagement_ingress_status_200_test ingress_gateways_test.go:50: ingress_gateways_test.go:50: STEP 1: Create httpbin Gateway and VirtualService with host set to httpbin.example.com ingress_gateways_test.go:57: ingress_gateways_test.go:57: STEP 2: Check if httpbin service is reachable through istio-ingressgateway ingress_gateways_test.go:59: FAILURE: expected status code 200 but got 503 Service Unavailable ingress_gateways_test.go:58: --- Attempt 1/60 failed. Retrying... ingress_gateways_test.go:59: FAILURE: expected status code 200 but got 503 Service Unavailable ingress_gateways_test.go:58: --- Attempt 2/60 failed. Retrying... ingress_gateways_test.go:59: FAILURE: expected status code 200 but got 503 Service Unavailable ingress_gateways_test.go:58: --- Attempt 3/60 failed. Retrying... ingress_gateways_test.go:59: FAILURE: expected status code 200 but got 503 Service Unavailable ingress_gateways_test.go:58: --- Attempt 4/60 failed. Retrying... ingress_gateways_test.go:59: SUCCESS: received expected status code 200 ingress_gateways_test.go:58: --- Attempt 5/60 successful; total time: 4.04s subtest.go:23: subtest.go:28: Subtest completed in 4.43s (excluding cleanup) --- PASS: TestIngressGateways/TrafficManagement_ingress_status_200_test (4.43s) === RUN TestIngressGateways/TrafficManagement_ingress_headers_test ingress_gateways_test.go:67: ingress_gateways_test.go:67: STEP 1: Create httpbin Gateway and VirtualService with host set to * ingress_gateways_test.go:70: ingress_gateways_test.go:70: STEP 2: Check if httpbin service is reachable through istio-ingressgateway ingress_gateways_test.go:72: FAILURE: expected status code 200 but got 404 Not Found ingress_gateways_test.go:71: --- Attempt 1/60 failed. Retrying... ingress_gateways_test.go:72: SUCCESS: received expected status code 200 ingress_gateways_test.go:71: --- Attempt 2/60 successful; total time: 1.02s subtest.go:23: subtest.go:28: Subtest completed in 1.38s (excluding cleanup) --- PASS: TestIngressGateways/TrafficManagement_ingress_headers_test (1.38s) test.go:77: test.go:82: Test completed in 31.53s (excluding cleanup) ingress_gateways_test.go:38: ingress_gateways_test.go:38: Performing cleanup ingress_gateways_test.go:39: Deleting namespaces: [bookinfo] ingress_gateways_test.go:39: Creating namespaces: [bookinfo] ingress_gateways_test.go:38: Cleanup completed in 17.51s --- PASS: TestIngressGateways (49.04s) === RUN TestIngressWithoutTlsTermination ingress_without_tls_termination_test.go:36: This test validates configuring an Gateway with TLS PassThrough ingress_without_tls_termination_test.go:37: Doc reference: https://istio.io/v1.14/docs/tasks/traffic-management/ingress/ingress-sni-passthrough/ ingress_without_tls_termination_test.go:46: ingress_without_tls_termination_test.go:46: STEP 1: Apply default SMCP and SMMR manifests ingress_without_tls_termination_test.go:46: Wait for condition condition=Ready on smcp istio-system/basic... ingress_without_tls_termination_test.go:46: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ingress_without_tls_termination_test.go:48: ingress_without_tls_termination_test.go:48: STEP 2: Create NGINX Deployment ingress_without_tls_termination_test.go:49: Install app "nginx" in namespace "bookinfo" ingress_without_tls_termination_test.go:49: Wait for app bookinfo/nginx to be ready ingress_without_tls_termination_test.go:51: ingress_without_tls_termination_test.go:51: STEP 3: Verify NGINX server is running by connecting to it via loopback ingress_without_tls_termination_test.go:53: SUCCESS: Got expected Welcome to nginx response ingress_without_tls_termination_test.go:63: ingress_without_tls_termination_test.go:63: STEP 4: Configure Gateway resource with TLS passthrough for host nginx.example.com ingress_without_tls_termination_test.go:70: ingress_without_tls_termination_test.go:70: STEP 5: Verify NGINX is reachable from outside the cluster through the ingressgateway ingress_without_tls_termination_test.go:74: SUCCESS: string 'Welcome to nginx' found in response test.go:77: test.go:82: Test completed in 15.25s (excluding cleanup) ingress_without_tls_termination_test.go:41: ingress_without_tls_termination_test.go:41: Performing cleanup ingress_without_tls_termination_test.go:41: Cleanup completed in 0.50s --- PASS: TestIngressWithoutTlsTermination (15.75s) === RUN TestSecureGateways secure_gateways_test.go:59: secure_gateways_test.go:59: STEP 1: Apply default SMCP and SMMR manifests secure_gateways_test.go:59: Wait for condition condition=Ready on smcp istio-system/basic... secure_gateways_test.go:59: SUCCESS: Condition condition=Ready met by smcp istio-system/basic secure_gateways_test.go:61: secure_gateways_test.go:61: STEP 2: Install httpbin secure_gateways_test.go:62: Install app "httpbin" in namespace "bookinfo" secure_gateways_test.go:62: Wait for app bookinfo/httpbin to be ready secure_gateways_test.go:66: secure_gateways_test.go:66: STEP 3: Create TLS secrets === RUN TestSecureGateways/tls_single_host secure_gateways_test.go:76: secure_gateways_test.go:76: STEP 1: Configure a TLS ingress gateway for a single host secure_gateways_test.go:84: failed to get HTTP Response: Get "https://httpbin.example.com:443/status/418": tls: failed to verify certificate: x509: certificate is valid for *.apps.ci-op-c4xxkqfp-8c5aa.cspilp.interop.ccitredhat.com, not httpbin.example.com secure_gateways_test.go:84: FAILURE: response is nil; the HTTP request must have failed secure_gateways_test.go:83: --- Attempt 1/60 failed. Retrying... secure_gateways_test.go:84: SUCCESS: string '-=[ teapot ]=-' found in response secure_gateways_test.go:83: --- Attempt 2/60 successful; total time: 1.03s subtest.go:23: subtest.go:28: Subtest completed in 1.34s (excluding cleanup) --- PASS: TestSecureGateways/tls_single_host (1.34s) === RUN TestSecureGateways/tls_multiple_hosts secure_gateways_test.go:93: secure_gateways_test.go:93: STEP 1: configure Gateway with multiple TLS hosts secure_gateways_test.go:101: secure_gateways_test.go:101: STEP 2: check if helloworld-v1 responds with 200 OK secure_gateways_test.go:103: failed to get HTTP Response: Get "https://helloworld-v1.example.com:443/hello": tls: failed to verify certificate: x509: certificate is valid for *.apps.ci-op-c4xxkqfp-8c5aa.cspilp.interop.ccitredhat.com, not helloworld-v1.example.com secure_gateways_test.go:103: FAILURE: response is nil; the HTTP request must have failed secure_gateways_test.go:102: --- Attempt 1/60 failed. Retrying... secure_gateways_test.go:103: failed to get HTTP Response: Get "https://helloworld-v1.example.com:443/hello": tls: failed to verify certificate: x509: certificate is valid for *.apps.ci-op-c4xxkqfp-8c5aa.cspilp.interop.ccitredhat.com, not helloworld-v1.example.com secure_gateways_test.go:103: FAILURE: response is nil; the HTTP request must have failed secure_gateways_test.go:102: --- Attempt 2/60 failed. Retrying... secure_gateways_test.go:103: failed to get HTTP Response: Get "https://helloworld-v1.example.com:443/hello": tls: failed to verify certificate: x509: certificate is valid for *.apps.ci-op-c4xxkqfp-8c5aa.cspilp.interop.ccitredhat.com, not helloworld-v1.example.com secure_gateways_test.go:103: FAILURE: response is nil; the HTTP request must have failed secure_gateways_test.go:102: --- Attempt 3/60 failed. Retrying... secure_gateways_test.go:103: failed to get HTTP Response: Get "https://helloworld-v1.example.com:443/hello": tls: failed to verify certificate: x509: certificate is valid for *.apps.ci-op-c4xxkqfp-8c5aa.cspilp.interop.ccitredhat.com, not helloworld-v1.example.com secure_gateways_test.go:103: FAILURE: response is nil; the HTTP request must have failed secure_gateways_test.go:102: --- Attempt 4/60 failed. Retrying... secure_gateways_test.go:103: SUCCESS: received expected status code 200 secure_gateways_test.go:102: --- Attempt 5/60 successful; total time: 4.13s secure_gateways_test.go:109: secure_gateways_test.go:109: STEP 3: check if httpbin responds with teapot secure_gateways_test.go:111: SUCCESS: string '-=[ teapot ]=-' found in response subtest.go:23: subtest.go:28: Subtest completed in 4.51s (excluding cleanup) --- PASS: TestSecureGateways/tls_multiple_hosts (4.51s) === RUN TestSecureGateways/mutual_tls secure_gateways_test.go:119: secure_gateways_test.go:119: STEP 1: configure Gateway with tls.mode=Mutual secure_gateways_test.go:130: secure_gateways_test.go:130: STEP 2: check if SSL handshake fails when no client certificate is given secure_gateways_test.go:132: FAILURE: expected request to fail because no client certificate was provided; expected request to fail, but it succeeded with the following status: 418 Unknown secure_gateways_test.go:131: --- Attempt 1/60 failed. Retrying... secure_gateways_test.go:132: failed to get HTTP Response: Get "https://httpbin.example.com:443/status/418": remote error: tls: certificate required secure_gateways_test.go:132: SUCCESS: request failed as expected secure_gateways_test.go:131: --- Attempt 2/60 successful; total time: 1.02s secure_gateways_test.go:140: secure_gateways_test.go:140: STEP 3: check if SSL handshake succeeds when client certificate is given secure_gateways_test.go:142: SUCCESS: string '-=[ teapot ]=-' found in response subtest.go:23: subtest.go:28: Subtest completed in 1.44s (excluding cleanup) --- PASS: TestSecureGateways/mutual_tls (1.44s) test.go:77: test.go:82: Test completed in 22.51s (excluding cleanup) secure_gateways_test.go:53: secure_gateways_test.go:53: Performing cleanup secure_gateways_test.go:56: Deleting namespaces: [bookinfo] secure_gateways_test.go:56: Creating namespaces: [bookinfo] secure_gateways_test.go:53: Cleanup completed in 17.59s --- PASS: TestSecureGateways (40.09s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/traffic/ingress 209.030s DONE 108 tests, 20 skipped, 1 failure in 1861.053s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAuthorizationTCPTraffic tcp_test.go:38: This test validates authorization policies for TCP traffic. tcp_test.go:39: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-tcp/ tcp_test.go:41: tcp_test.go:41: STEP 1: Apply default SMCP and SMMR manifests tcp_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... tcp_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic tcp_test.go:43: tcp_test.go:43: STEP 2: Install sleep and echo tcp_test.go:44: Install app "sleep" in namespace "foo" tcp_test.go:44: Install app "echo" in namespace "foo" tcp_test.go:44: Wait for app foo/sleep to be ready tcp_test.go:44: Wait for app foo/echo to be ready tcp_test.go:47: tcp_test.go:47: STEP 3: Verify sleep to echo TCP connections tcp_test.go:103: SUCCESS: Got expected hello message on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 1/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 2/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 3/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 4/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 5/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 6/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 7/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 8/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 9/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 10/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 11/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 12/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 13/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 14/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 15/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 16/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 17/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 18/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 19/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 20/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 21/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 22/120 failed. Retrying... tcp_test.go:103: SUCCESS: Got expected hello message on port 9002 tcp_test.go:53: --- Attempt 23/120 successful; total time: 27.40s === RUN TestAuthorizationTCPTraffic/TCP_ALLOW_policy tcp_test.go:61: tcp_test.go:61: STEP 1: Apply a policy to allow tcp requests to port 9000 and 9001 tcp_test.go:103: SUCCESS: Got expected hello message on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9002 subtest.go:23: subtest.go:28: Subtest completed in 0.94s (excluding cleanup) tcp_test.go:58: tcp_test.go:58: Performing cleanup tcp_test.go:58: Cleanup completed in 0.06s --- PASS: TestAuthorizationTCPTraffic/TCP_ALLOW_policy (1.00s) === RUN TestAuthorizationTCPTraffic/TCP_invalid_policy tcp_test.go:78: tcp_test.go:78: STEP 1: Apply an invalid policy to allow requests to port 9000 and add an HTTP GET field tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 0.74s (excluding cleanup) tcp_test.go:75: tcp_test.go:75: Performing cleanup tcp_test.go:75: Cleanup completed in 0.07s --- PASS: TestAuthorizationTCPTraffic/TCP_invalid_policy (0.81s) === RUN TestAuthorizationTCPTraffic/TCP_deny_policy tcp_test.go:91: tcp_test.go:91: STEP 1: Apply a policy to deny tcp requests to port 9000 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 0.75s (excluding cleanup) tcp_test.go:88: tcp_test.go:88: Performing cleanup tcp_test.go:88: Cleanup completed in 0.06s --- PASS: TestAuthorizationTCPTraffic/TCP_deny_policy (0.81s) test.go:77: test.go:82: Test completed in 42.09s (excluding cleanup) tcp_test.go:34: tcp_test.go:34: Performing cleanup tcp_test.go:35: Deleting namespaces: [foo] tcp_test.go:35: Creating namespaces: [foo] tcp_test.go:34: Cleanup completed in 12.57s --- PASS: TestAuthorizationTCPTraffic (54.66s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/authorization 54.944s === Skipped === SKIP: pkg/tests/non-dependant TestSMCPMultiple (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestIstiodPodFailsAfterRestarts (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestDeployOnInfraNodes (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestDiscoverySelectors (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestInitContainerNotRemovedDuringInjection (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestIOR (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestOperatorCanUpdatePrometheusConfigMap (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestRateLimiting (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestSMCPAddons (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestSMCPAnnotations (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestMustGather (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestSMMRAutoCreationAndDeletion (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm-federation TestMultiClusterFederationFailover (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm-federation TestFederation (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm-federation TestFederationDifferentCerts (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm/operator TestClusterWideMode (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm/operator TestOperatorCanReconcileSMCPWhenIstiodOffline (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm/operator TestOperatorPodHonorsReadinessProbe (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/tasks/observability TestCustomPrometheus (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/tasks/observability TestOpenShiftMonitoring (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === Failed === FAIL: pkg/tests/tasks/security/authorization TestAuthorizationTCPTraffic (222.81s) tcp_test.go:38: This test validates authorization policies for TCP traffic. tcp_test.go:39: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-tcp/ tcp_test.go:41: tcp_test.go:41: STEP 1: Apply default SMCP and SMMR manifests tcp_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... tcp_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic tcp_test.go:43: tcp_test.go:43: STEP 2: Install sleep and echo tcp_test.go:44: Install app "sleep" in namespace "foo" tcp_test.go:44: Install app "echo" in namespace "foo" tcp_test.go:44: Wait for app foo/sleep to be ready tcp_test.go:44: Wait for app foo/echo to be ready tcp_test.go:47: tcp_test.go:47: STEP 3: Verify sleep to echo TCP connections tcp_test.go:103: SUCCESS: Got expected hello message on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 1/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 2/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 3/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 4/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 5/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 6/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 7/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 8/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 9/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 10/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 11/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 12/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 13/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 14/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 15/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 16/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 17/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 18/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 19/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 20/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 21/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 22/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 23/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 24/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 25/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 26/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 27/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 28/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 29/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 30/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 31/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 32/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 33/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 34/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 35/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 36/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 37/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 38/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 39/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 40/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 41/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 42/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 43/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 44/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 45/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 46/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 47/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 48/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 49/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 50/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 51/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 52/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 53/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 54/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 55/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 56/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 57/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 58/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 59/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 60/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 61/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 62/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 63/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 64/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 65/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 66/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 67/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 68/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 69/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 70/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 71/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 72/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 73/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 74/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 75/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 76/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 77/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 78/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 79/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 80/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 81/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 82/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 83/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 84/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 85/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 86/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 87/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 88/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 89/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 90/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 91/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 92/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 93/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 94/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 95/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 96/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 97/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 98/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 99/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 100/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 101/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 102/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 103/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 104/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 105/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 106/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 107/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 108/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 109/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 110/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 111/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 112/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 113/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 114/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 115/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 116/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 117/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 118/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found tcp_test.go:53: --- Attempt 119/120 failed. Retrying... tcp_test.go:103: FAILURE: Expected return message hello, but failed on port 9002; expected to find the string 'connection succeeded' in the output, but it wasn't found; full output: connection rejected tcp_test.go:53: Last attempt (120/120) failed. test.go:77: test.go:79: Test failed in 167.95s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230717063758/v2.4/failures-must-gather/20230717065130-TestAuthorizationTCPTraffic tcp_test.go:34: tcp_test.go:34: Performing cleanup tcp_test.go:35: Deleting namespaces: [foo] tcp_test.go:35: Creating namespaces: [foo] tcp_test.go:34: Cleanup completed in 11.87s tcp_test.go:61: tcp_test.go:61: STEP 1: Apply a policy to allow tcp requests to port 9000 and 9001 tcp_test.go:103: SUCCESS: Got expected hello message on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9002 subtest.go:23: subtest.go:28: Subtest completed in 1.43s (excluding cleanup) tcp_test.go:58: tcp_test.go:58: Performing cleanup tcp_test.go:58: Cleanup completed in 0.09s --- PASS: TestAuthorizationTCPTraffic/TCP_ALLOW_policy (1.52s) tcp_test.go:78: tcp_test.go:78: STEP 1: Apply an invalid policy to allow requests to port 9000 and add an HTTP GET field tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 1.14s (excluding cleanup) tcp_test.go:75: tcp_test.go:75: Performing cleanup tcp_test.go:75: Cleanup completed in 0.06s --- PASS: TestAuthorizationTCPTraffic/TCP_invalid_policy (1.21s) tcp_test.go:91: tcp_test.go:91: STEP 1: Apply a policy to deny tcp requests to port 9000 tcp_test.go:115: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:103: SUCCESS: Got expected hello message on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 0.92s (excluding cleanup) tcp_test.go:88: tcp_test.go:88: Performing cleanup tcp_test.go:88: Cleanup completed in 0.06s --- PASS: TestAuthorizationTCPTraffic/TCP_deny_policy (0.99s) DONE 2 runs, 112 tests, 20 skipped, 1 failure in 1916.966s ====== JUnit report file(s) v2.4: /go/src/maistra-test-tool/tests/result-20230717063758/v2.4/report.xml ====== Test summary v2.4: DONE 2 runs, 112 tests, 20 skipped, 1 failure in 1916.966s real 31m58.030s user 4m20.391s sys 1m14.768s Copying logs and xmls to /logs/artifacts kubectl delete ns istio-system bookinfo foo bar mesh-external legacy --ignore-not-found namespace "istio-system" deleted namespace "bookinfo" deleted namespace "foo" deleted namespace "bar" deleted namespace "mesh-external" deleted namespace "legacy" deleted