Executing tests against SMCP version 2.3 WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 76 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Resetting cluster by deleting namespaces used in the test suite namespace "istio-system" deleted namespace "bookinfo" deleted namespace "foo" deleted namespace "bar" deleted namespace "legacy" deleted namespace "mesh-external" deleted Output dir: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3 ====== Executing tests in group 'full' against SMCP v2.3 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/prometheus/common v0.42.0 go: downloading golang.org/x/net v0.7.0 go: downloading github.com/sirupsen/logrus v1.8.1 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading github.com/prometheus/client_model v0.3.0 go: downloading github.com/golang/protobuf v1.5.2 go: downloading golang.org/x/sys v0.5.0 go: downloading google.golang.org/protobuf v1.28.1 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestSMCPMultiple bug_multiple_smcp_test.go:18: This test verifies whether the operator only reconciles one SMCP when two exist in a namespace bug_multiple_smcp_test.go:19: See https://issues.redhat.com/browse/OSSM-2189 bug_multiple_smcp_test.go:41: bug_multiple_smcp_test.go:41: STEP 1: Delete and recreate namespace istio-system bug_multiple_smcp_test.go:42: Deleting namespaces: [istio-system] bug_multiple_smcp_test.go:42: Creating namespaces: [istio-system] bug_multiple_smcp_test.go:44: bug_multiple_smcp_test.go:44: STEP 2: Delete the operator's ValidationWebhookConfiguration bug_multiple_smcp_test.go:47: bug_multiple_smcp_test.go:47: STEP 3: Create the first SMCP bug_multiple_smcp_test.go:50: bug_multiple_smcp_test.go:50: STEP 4: Check whether the first SMCP gets reconciled and becomes ready bug_multiple_smcp_test.go:51: Wait for condition condition=Ready on smcp istio-system/smcp1... bug_multiple_smcp_test.go:51: Wait for condition condition=Ready on smcp istio-system/smcp1... bug_multiple_smcp_test.go:51: SUCCESS: Condition condition=Ready met by smcp istio-system/smcp1 bug_multiple_smcp_test.go:52: SUCCESS: First SMCP is ready bug_multiple_smcp_test.go:54: bug_multiple_smcp_test.go:54: STEP 5: Create the second SMCP bug_multiple_smcp_test.go:57: bug_multiple_smcp_test.go:57: STEP 6: Check whether the second SMCP shows ErrMultipleSMCPs bug_multiple_smcp_test.go:58: SUCCESS: The second SMCP status is ErrMultipleSMCPs test.go:77: test.go:82: Test completed in 32.28s (excluding cleanup) bug_multiple_smcp_test.go:24: bug_multiple_smcp_test.go:24: Performing cleanup bug_multiple_smcp_test.go:25: bug_multiple_smcp_test.go:25: STEP 7: Delete namespace istio-system bug_multiple_smcp_test.go:26: Deleting namespaces: [istio-system] bug_multiple_smcp_test.go:26: Creating namespaces: [istio-system] bug_multiple_smcp_test.go:28: bug_multiple_smcp_test.go:28: STEP 8: Delete operator to recreate the ValidationWebhookConfiguration bug_multiple_smcp_test.go:29: SUCCESS: Pod istio-operator-8cc9f5444-49bdt is being deleted bug_multiple_smcp_test.go:31: bug_multiple_smcp_test.go:31: STEP 9: Wait for operator pod to be ready bug_multiple_smcp_test.go:32: Pod istio-operator-8cc9f5444-6g766 in namespace openshift-operators is ready! bug_multiple_smcp_test.go:34: bug_multiple_smcp_test.go:34: STEP 10: Check whether ValidatingWebhookConfiguration exists bug_multiple_smcp_test.go:35: SUCCESS: ValidatingWebhookConfiguration was recreated by the operator bug_multiple_smcp_test.go:24: Cleanup completed in 55.17s --- PASS: TestSMCPMultiple (87.45s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/non-dependant 91.496s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestIstiodPodFailsAfterRestarts bug_istiopods_test.go:38: bug_istiopods_test.go:38: STEP 1: Apply default SMCP and SMMR manifests bug_istiopods_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... bug_istiopods_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... bug_istiopods_test.go:38: SUCCESS: Condition condition=Ready met by smcp istio-system/basic bug_istiopods_test.go:40: bug_istiopods_test.go:40: STEP 2: Create Namespaces and SMMR bug_istiopods_test.go:41: Creating namespaces: [test-0 test-1 test-2 test-3 test-4 test-5 test-6 test-7 test-8 test-9 test-10 test-11 test-12 test-13 test-14 test-15 test-16 test-17 test-18 test-19 test-20 test-21 test-22 test-23 test-24 test-25 test-26 test-27 test-28 test-29 test-30 test-31 test-32 test-33 test-34 test-35 test-36 test-37 test-38 test-39 test-40 test-41 test-42 test-43 test-44 test-45 test-46 test-47 test-48 test-49] bug_istiopods_test.go:44: bug_istiopods_test.go:44: STEP 3: Delete Istio pod 10 times and check that it is running and ready after the deletions bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-zbvxw is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-pv8fm is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-pv8fm in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-pv8fm is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-c2rvd is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-c2rvd in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-c2rvd is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-4czd7 is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-4czd7 in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-4czd7 is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-ppndg is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-ppndg in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-ppndg is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-dlh26 is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-dlh26 in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-dlh26 is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-xt2kl is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-xt2kl in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-xt2kl is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-5zws7 is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-5zws7 in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-5zws7 is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-lcvn8 is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-lcvn8 in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-lcvn8 is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-qfrbk is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-qfrbk in namespace istio-system is ready! bug_istiopods_test.go:47: SUCCESS: Pod istiod-basic-7b5bbdfcff-qfrbk is being deleted bug_istiopods_test.go:48: Pod istio-system/istiod-basic-7b5bbdfcff-l2z8r is running! bug_istiopods_test.go:49: Pod istiod-basic-7b5bbdfcff-l2z8r in namespace istio-system is ready! test.go:77: test.go:82: Test completed in 171.80s (excluding cleanup) bug_istiopods_test.go:33: bug_istiopods_test.go:33: Performing cleanup bug_istiopods_test.go:34: Deleting namespaces: [test-0 test-1 test-2 test-3 test-4 test-5 test-6 test-7 test-8 test-9 test-10 test-11 test-12 test-13 test-14 test-15 test-16 test-17 test-18 test-19 test-20 test-21 test-22 test-23 test-24 test-25 test-26 test-27 test-28 test-29 test-30 test-31 test-32 test-33 test-34 test-35 test-36 test-37 test-38 test-39 test-40 test-41 test-42 test-43 test-44 test-45 test-46 test-47 test-48 test-49] bug_istiopods_test.go:33: Cleanup completed in 52.86s --- PASS: TestIstiodPodFailsAfterRestarts (224.66s) === RUN TestDeployOnInfraNodes deploy_on_infra_test.go:37: This test verifies that the OSSM operator and Istio components can be configured to run on infrastructure nodes deploy_on_infra_test.go:63: deploy_on_infra_test.go:63: STEP 1: Setup: Get a worker node from the cluster that does not have the istio operator installed and label it as infra deploy_on_infra_test.go:65: Worker node selected: ppc64le-qe59c-w2tm2-worker-0-6gn6s === RUN TestDeployOnInfraNodes/operator deploy_on_infra_test.go:73: Verify OSSM Operator is deployed on infra node when configured deploy_on_infra_test.go:74: Reference: https://issues.redhat.com/browse/OSSM-2342 deploy_on_infra_test.go:76: deploy_on_infra_test.go:76: STEP 1: Patch subscription to run on infra nodes and wait for the operator pod to be ready deploy_on_infra_test.go:91: deploy_on_infra_test.go:91: STEP 2: Verify operator pod is running on the infra node. Node expected: ppc64le-qe59c-w2tm2-worker-0-6gn6s deploy_on_infra_test.go:94: Pod istio-operator-8cc9f5444-6g766 in namespace openshift-operators is ready! deploy_on_infra_test.go:94: Pod istio-operator-8cc9f5444-6g766 in namespace openshift-operators is ready! deploy_on_infra_test.go:94: Pod istio-operator-79ff4dc94-l9fd4 in namespace openshift-operators is ready! deploy_on_infra_test.go:92: SUCCESS: Operator pod is running on the infra node subtest.go:23: subtest.go:28: Subtest completed in 26.01s (excluding cleanup) --- PASS: TestDeployOnInfraNodes/operator (26.01s) === RUN TestDeployOnInfraNodes/control_plane deploy_on_infra_test.go:106: Verify that all control plane pods are deployed on infra node when configured deploy_on_infra_test.go:111: deploy_on_infra_test.go:111: STEP 1: Apply default SMCP and SMMR manifests deploy_on_infra_test.go:111: Wait for condition condition=Ready on smcp istio-system/basic... deploy_on_infra_test.go:111: Wait for condition condition=Ready on smcp istio-system/basic... deploy_on_infra_test.go:111: SUCCESS: Condition condition=Ready met by smcp istio-system/basic deploy_on_infra_test.go:113: deploy_on_infra_test.go:113: STEP 2: Deploy SMCP and patch to run all control plane components on infra nodes deploy_on_infra_test.go:130: SUCCESS: Condition condition=Ready met by smcp istio-system/basic deploy_on_infra_test.go:114: Wait for condition condition=Ready on smcp istio-system/basic... deploy_on_infra_test.go:114: Wait for condition condition=Ready on smcp istio-system/basic... deploy_on_infra_test.go:114: Wait for condition condition=Ready on smcp istio-system/basic... deploy_on_infra_test.go:133: deploy_on_infra_test.go:133: STEP 3: Verify that the following control plane pods are running on the infra node: istiod, istio-ingressgateway, istio-egressgateway, jaeger, grafana, prometheus deploy_on_infra_test.go:146: SUCCESS: istiod-basic-54965db49-bnzjn is running on the infra node deploy_on_infra_test.go:146: SUCCESS: istio-ingressgateway-6dbfb764bf-v9bfs is running on the infra node deploy_on_infra_test.go:146: SUCCESS: istio-egressgateway-64dfd5dd56-sk9md is running on the infra node deploy_on_infra_test.go:146: SUCCESS: grafana-55dbb9d9c8-jcntg is running on the infra node deploy_on_infra_test.go:146: SUCCESS: prometheus-89f9fcb7d-9jncw is running on the infra node deploy_on_infra_test.go:146: SUCCESS: jaeger-65fc54ddcf-5fx4r is running on the infra node subtest.go:23: subtest.go:28: Subtest completed in 150.69s (excluding cleanup) deploy_on_infra_test.go:107: deploy_on_infra_test.go:107: Performing cleanup deploy_on_infra_test.go:108: Deleting namespaces: [istio-system] deploy_on_infra_test.go:108: Creating namespaces: [istio-system] deploy_on_infra_test.go:107: Cleanup completed in 42.71s --- PASS: TestDeployOnInfraNodes/control_plane (193.39s) test.go:77: test.go:82: Test completed in 221.71s (excluding cleanup) deploy_on_infra_test.go:50: deploy_on_infra_test.go:50: Performing cleanup deploy_on_infra_test.go:60: Pod istio-operator-79ff4dc94-l9fd4 in namespace openshift-operators is ready! deploy_on_infra_test.go:50: Cleanup completed in 2.43s --- PASS: TestDeployOnInfraNodes (224.14s) === RUN TestDiscoverySelectors discovery_selectors_test.go:34: This test checks if discoverySelectors are being honored discovery_selectors_test.go:35: See https://issues.redhat.com/browse/OSSM-3802 discovery_selectors_test.go:36: Test case is based on https://istio.io/latest/blog/2021/discovery-selectors/ discovery_selectors_test.go:38: Skipped because spec.meshConfig.discoverySelectors is only available in v2.4+ test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestDiscoverySelectors (0.00s) === RUN TestInitContainerNotRemovedDuringInjection initcontainer_test.go:32: Checking init container not removed during sidecar injection. initcontainer_test.go:38: initcontainer_test.go:38: STEP 1: Apply default SMCP and SMMR manifests setup.go:114: FATAL: Command failed: oc -n istio-system apply -f - Error from server (InternalError): error when creating "STDIN": Internal error occurred: failed calling webhook "smcp.mutation.maistra.io": failed to call webhook: Post "https://maistra-admission-controller.openshift-operators.svc:443/mutate-smcp?timeout=10s": no endpoints available for service "maistra-admission-controller" error: exit status 1 test.go:77: test.go:79: Test failed in 2.26s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714113526-TestInitContainerNotRemovedDuringInjection initcontainer_test.go:34: initcontainer_test.go:34: Performing cleanup initcontainer_test.go:35: Deleting namespaces: [bookinfo] initcontainer_test.go:35: Creating namespaces: [bookinfo] initcontainer_test.go:34: Cleanup completed in 8.29s --- FAIL: TestInitContainerNotRemovedDuringInjection (53.20s) === RUN TestIOR ior_test.go:41: This test verifies the behavior of IOR. ior_test.go:73: ior_test.go:73: STEP 1: Apply default SMCP and SMMR manifests ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestIOR/check_IOR_off_by_default_v2.5 ior_test.go:77: Skipping until 2.5 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) --- SKIP: TestIOR/check_IOR_off_by_default_v2.5 (0.00s) === RUN TestIOR/check_IOR_basic_functionalities ior_test.go:98: ior_test.go:98: STEP 1: Ensure the IOR enabled ior_test.go:103: ior_test.go:103: STEP 2: Check whether the IOR creates Routes for hosts specified in the Gateway ior_test.go:53: Creating Gateway for www.test.ocp host ior_test.go:58: Checking whether a Route is generated for www.test.ocp ior_test.go:68: SUCCESS: Got an expected Route for www.test.ocp subtest.go:23: subtest.go:28: Subtest completed in 1.91s (excluding cleanup) ior_test.go:92: ior_test.go:92: Performing cleanup ior_test.go:92: Cleanup completed in 0.00s --- PASS: TestIOR/check_IOR_basic_functionalities (1.91s) === RUN TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade ior_test.go:110: This test only applies for v2.3 to v2.4 upgrade subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) --- SKIP: TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade (0.00s) === RUN TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:161: ior_test.go:161: STEP 1: Ensure the IOR enabled ior_test.go:166: ior_test.go:166: STEP 2: Create 3 Gateways and they are in their own Namespace ior_test.go:176: Creating namespaces: [ns-0 ns-1 ns-2] ior_test.go:179: ior_test.go:179: STEP 3: Update SMMR to include 3 Namespaces ior_test.go:186: FATAL: Expect to find 3 Routes but found 4 instead subtest.go:23: subtest.go:25: Subtest failed in 83.71s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714113807-TestIOR-check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:151: ior_test.go:151: Performing cleanup ior_test.go:156: Deleting namespaces: [ns-0 ns-1 ns-2] ior_test.go:151: Cleanup completed in 15.36s --- FAIL: TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod (222.30s) test.go:77: test.go:79: Test failed in 247.79s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714114025-TestIOR ior_test.go:46: ior_test.go:46: Performing cleanup ior_test.go:47: Deleting namespaces: [istio-system] ior_test.go:47: Creating namespaces: [istio-system] ior_test.go:46: Cleanup completed in 41.31s --- FAIL: TestIOR (382.27s) === RUN TestOperatorCanUpdatePrometheusConfigMap prometheus_scoped_scraping_test.go:28: This test checks if the operator can update Prometheus ConfigMap when the SMMR is updated prometheus_scoped_scraping_test.go:31: Test only valid in SMCP versions v2.4+ test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestOperatorCanUpdatePrometheusConfigMap (0.00s) === RUN TestRateLimiting test.go:120: This test is being skipped because it doesn't support the current SMCP version v2.3 (max version is v2.2) --- SKIP: TestRateLimiting (0.00s) === RUN TestSMCPAddons === RUN TestSMCPAddons/3scale_addon smcp_addons_test.go:31: smcp_addons_test.go:31: STEP 1: Enable 3scale in a SMCP expecting to get validation error. smcp_addons_test.go:36: smcp_addons_test.go:36: STEP 2: Apply default SMCP and SMMR manifests smcp_addons_test.go:36: Wait for condition condition=Ready on smcp istio-system/basic... smcp_addons_test.go:36: Wait for condition condition=Ready on smcp istio-system/basic... smcp_addons_test.go:36: Wait for condition condition=Ready on smcp istio-system/basic... smcp_addons_test.go:36: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smcp_addons_test.go:38: SUCCESS: Got expected validation error: support for 3scale has been removed smcp_addons_test.go:43: Wait for condition condition=Ready on smcp istio-system/basic... smcp_addons_test.go:43: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 26.33s (excluding cleanup) smcp_addons_test.go:32: smcp_addons_test.go:32: Performing cleanup smcp_addons_test.go:32: Cleanup completed in 0.41s --- PASS: TestSMCPAddons/3scale_addon (26.73s) test.go:77: test.go:82: Test completed in 26.73s (excluding cleanup) --- PASS: TestSMCPAddons (26.73s) === RUN TestSMCPAnnotations smcp_annotation_test.go:31: Test annotations: verify deployment with sidecar.maistra.io/proxyEnv annotations and Enable automatic injection in SMCP to propagate the annotations to the sidecar smcp_annotation_test.go:33: smcp_annotation_test.go:33: STEP 1: Apply default SMCP and SMMR manifests smcp_annotation_test.go:33: Wait for condition condition=Ready on smcp istio-system/basic... smcp_annotation_test.go:33: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestSMCPAnnotations/proxyEnvoy === PAUSE TestSMCPAnnotations/proxyEnvoy === RUN TestSMCPAnnotations/quote_injection === PAUSE TestSMCPAnnotations/quote_injection test.go:77: test.go:82: Test completed in 12.21s (excluding cleanup) === CONT TestSMCPAnnotations/proxyEnvoy === CONT TestSMCPAnnotations/quote_injection smcp_annotation_test.go:41: smcp_annotation_test.go:41: STEP 1: Deploy TestSSL pod with annotations sidecar.maistra.io/proxyEnv smcp_annotation_test.go:58: smcp_annotation_test.go:58: STEP 1: Enable annotation auto injection in SMCP smcp_annotation_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... smcp_annotation_test.go:45: smcp_annotation_test.go:45: STEP 2: Get annotations and verify that the pod has the expected: sidecar.maistra.io/proxyEnv : { "maistra_test_env": "env_value", "maistra_test_env_2": "env_value_2" } subtest.go:23: subtest.go:28: Subtest completed in 7.96s (excluding cleanup) smcp_annotation_test.go:38: smcp_annotation_test.go:38: Performing cleanup smcp_annotation_test.go:38: Cleanup completed in 0.30s --- PASS: TestSMCPAnnotations/proxyEnvoy (8.26s) smcp_annotation_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... smcp_annotation_test.go:64: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smcp_annotation_test.go:66: smcp_annotation_test.go:66: STEP 2: Deploy TestSSL pod with annotations sidecar.maistra.io/proxyEnv smcp_annotation_test.go:70: smcp_annotation_test.go:70: STEP 3: Get annotations and verify that the pod has the expected: test1.annotation-from-smcp : test1, test2.annotation-from-smcp : ["test2"], test3.annotation-from-smcp : {test3} subtest.go:23: subtest.go:28: Subtest completed in 18.75s (excluding cleanup) smcp_annotation_test.go:54: smcp_annotation_test.go:54: Performing cleanup smcp_annotation_test.go:54: Cleanup completed in 0.60s --- PASS: TestSMCPAnnotations/quote_injection (19.35s) --- PASS: TestSMCPAnnotations (12.21s) === RUN TestMustGather smcp_must_gather_test.go:36: This test verifies must-gather log collection smcp_must_gather_test.go:43: smcp_must_gather_test.go:43: STEP 1: Apply default SMCP and SMMR manifests smcp_must_gather_test.go:43: Wait for condition condition=Ready on smcp istio-system/basic... smcp_must_gather_test.go:43: Wait for condition condition=Ready on smcp istio-system/basic... smcp_must_gather_test.go:43: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smcp_must_gather_test.go:45: smcp_must_gather_test.go:45: STEP 2: Deploy bookinfo in bookinfo ns smcp_must_gather_test.go:46: Install app "bookinfo" in namespace "bookinfo" smcp_must_gather_test.go:46: Create Bookinfo Gateway smcp_must_gather_test.go:46: Create Bookinfo Destination Rules (all) smcp_must_gather_test.go:46: Create Bookinfo Deployments smcp_must_gather_test.go:46: Wait for app bookinfo/bookinfo to be ready smcp_must_gather_test.go:51: smcp_must_gather_test.go:51: STEP 3: Capture must-gather using image registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 without namespace flag smcp_must_gather_test.go:52: SUCCESS: Must gather completed successfully === RUN TestMustGather/dump_files_and_proxy_stats_files_exist_for_pods smcp_must_gather_test.go:60: smcp_must_gather_test.go:60: STEP 1: Check dump files exist under the directory of namespace directory smcp_must_gather_test.go:61: Verify these files: smcp_must_gather_test.go:62: config_dump_istiod.json, config_dump_proxy.json, proxy_stats smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/bookinfo/pods/details*/config_dump_istiod.json exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/bookinfo/pods/details*/config_dump_proxy.json exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/bookinfo/pods/details*/proxy_stats exists smcp_must_gather_test.go:68: smcp_must_gather_test.go:68: STEP 2: verify content of proxy_stats smcp_must_gather_test.go:69: verify that proxy stats file is not empty and contains parameters like: server.stats_recent_lookups, server.total_connections, server.uptime, server.version smcp_must_gather_test.go:176: SUCCESS: server.stats_recent_lookups is on the proxy_stats file smcp_must_gather_test.go:176: SUCCESS: server.total_connections is on the proxy_stats file smcp_must_gather_test.go:176: SUCCESS: server.uptime is on the proxy_stats file smcp_must_gather_test.go:176: SUCCESS: server.version is on the proxy_stats file subtest.go:23: subtest.go:28: Subtest completed in 0.12s (excluding cleanup) --- PASS: TestMustGather/dump_files_and_proxy_stats_files_exist_for_pods (0.12s) === RUN TestMustGather/version_file smcp_must_gather_test.go:83: smcp_must_gather_test.go:83: STEP 1: verify file version exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/version exists smcp_must_gather_test.go:87: smcp_must_gather_test.go:87: STEP 2: verify file version contains the version of the must-gather image smcp_must_gather_test.go:176: SUCCESS: Expected must gather version was found subtest.go:23: subtest.go:28: Subtest completed in 0.01s (excluding cleanup) --- PASS: TestMustGather/version_file (0.01s) === RUN TestMustGather/resources_cluster_scoped smcp_must_gather_test.go:98: smcp_must_gather_test.go:98: STEP 1: Get nodes of the cluster smcp_must_gather_test.go:102: smcp_must_gather_test.go:102: STEP 2: verify nodes files exist in cluster-scoped-resources smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/core/nodes/ppc64le-qe59c-w2tm2-master-0.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/core/nodes/ppc64le-qe59c-w2tm2-master-1.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/core/nodes/ppc64le-qe59c-w2tm2-master-2.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/core/nodes/ppc64le-qe59c-w2tm2-worker-0-465fr.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/core/nodes/ppc64le-qe59c-w2tm2-worker-0-6gn6s.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/core/nodes/ppc64le-qe59c-w2tm2-worker-0-ggxls.yaml exists smcp_must_gather_test.go:111: smcp_must_gather_test.go:111: STEP 3: Verify cluster-scoped-resources files exist in cluster-scoped-resources folder smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/rbac.authorization.k8s.io/clusterrolebindings/istiod-internal-basic-istio-system.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/admissionregistration.k8s.io/mutatingwebhookconfigurations/openshift-operators.servicemesh-resources.maistra.io.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/istiod-clusterrole-basic-istio-system.yaml exists subtest.go:23: subtest.go:28: Subtest completed in 0.50s (excluding cleanup) --- PASS: TestMustGather/resources_cluster_scoped (0.50s) === RUN TestMustGather/resource_for_namespaces_exist smcp_must_gather_test.go:120: smcp_must_gather_test.go:120: STEP 1: verify that resources for namespaces are created including bookinfo and istio-system folders smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/istio-system/debug-syncz.json exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/istio-system/istio-system.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/bookinfo/bookinfo.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/openshift-operators/openshift-operators.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/*/rbac.authorization.k8s.io/rolebindings/mesh-users.yaml exists subtest.go:23: subtest.go:28: Subtest completed in 0.01s (excluding cleanup) --- PASS: TestMustGather/resource_for_namespaces_exist (0.01s) === RUN TestMustGather/cluster_service_version_files_validation smcp_must_gather_test.go:131: smcp_must_gather_test.go:131: STEP 1: Get service current service version from the cluster smcp_must_gather_test.go:134: smcp_must_gather_test.go:134: STEP 2: verify if the csv files exist for the current service version smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/elasticsearch-operator.v5.6.5.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/jaeger-operator.v1.42.0-5-0.1687199951.p.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/kiali-operator.v1.65.7.yaml exists smcp_must_gather_test.go:153: SUCCESS: /tmp/must-gather-1200109990/**/namespaces/openshift-operators/operators.coreos.com/clusterserviceversions/servicemeshoperator.v2.4.1.yaml exists subtest.go:23: subtest.go:28: Subtest completed in 0.55s (excluding cleanup) --- PASS: TestMustGather/cluster_service_version_files_validation (0.55s) test.go:77: test.go:82: Test completed in 139.48s (excluding cleanup) smcp_must_gather_test.go:39: smcp_must_gather_test.go:39: Performing cleanup smcp_must_gather_test.go:40: Deleting namespaces: [bookinfo] smcp_must_gather_test.go:40: Creating namespaces: [bookinfo] smcp_must_gather_test.go:39: Cleanup completed in 21.86s --- PASS: TestMustGather (161.34s) === RUN TestTLSVersionSMCP smcp_tls_ssl_test.go:25: This test checks if the SMCP updated the tls.minProtocolVersion to TLSv1_0, TLSv1_1, and tls.maxProtocolVersion to TLSv1_3. smcp_tls_ssl_test.go:34: smcp_tls_ssl_test.go:34: STEP 1: Apply default SMCP and SMMR manifests smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestTLSVersionSMCP/minVersion_TLSv1_0 smcp_tls_ssl_test.go:37: smcp_tls_ssl_test.go:37: STEP 1: Update SMCP spec.security.controlPlane.tls.minProtocolVersion: TLSv1_0 smcp_tls_ssl_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:39: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 13.93s (excluding cleanup) --- PASS: TestTLSVersionSMCP/minVersion_TLSv1_0 (13.93s) === RUN TestTLSVersionSMCP/minVersion_TLSv1_1 smcp_tls_ssl_test.go:43: smcp_tls_ssl_test.go:43: STEP 1: Check to see if the SMCP minProtocolVersion is TLSv1_1 smcp_tls_ssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 14.40s (excluding cleanup) --- PASS: TestTLSVersionSMCP/minVersion_TLSv1_1 (14.40s) === RUN TestTLSVersionSMCP/maxVersion_TLSv1_3 smcp_tls_ssl_test.go:49: smcp_tls_ssl_test.go:49: STEP 1: Check to see if the SMCP maxProtocolVersion is TLSv1_3 smcp_tls_ssl_test.go:51: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:51: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:51: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 15.51s (excluding cleanup) --- PASS: TestTLSVersionSMCP/maxVersion_TLSv1_3 (15.51s) test.go:77: test.go:82: Test completed in 55.84s (excluding cleanup) smcp_tls_ssl_test.go:26: smcp_tls_ssl_test.go:26: Performing cleanup smcp_tls_ssl_test.go:31: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:31: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:31: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smcp_tls_ssl_test.go:26: Cleanup completed in 15.66s --- PASS: TestTLSVersionSMCP (71.50s) === RUN TestSMMRAutoCreationAndDeletion smm_test.go:17: This test verifies what happens to the SMMR when SMM is created and deleted smm_test.go:24: smm_test.go:24: STEP 1: Apply default SMCP and SMMR manifests smm_test.go:24: Wait for condition condition=Ready on smcp istio-system/basic... smm_test.go:24: Wait for condition condition=Ready on smcp istio-system/basic... smm_test.go:24: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smm_test.go:26: smm_test.go:26: STEP 2: Delete SMMR smm_test.go:29: smm_test.go:29: STEP 3: Create two namespaces smm_test.go:30: Creating namespaces: [foo bar] === RUN TestSMMRAutoCreationAndDeletion/create_first_SMM smm_test.go:33: This test checks if the SMMR is created when you create a ServiceMeshMember smm_test.go:35: smm_test.go:35: STEP 1: Create ServiceMeshMembers in namespaces foo and bar smm_test.go:39: smm_test.go:39: STEP 2: Wait for SMMR to be ready smm_test.go:42: smm_test.go:42: STEP 3: Check both namespaces are shown as members in SMMR smm_test.go:43: SUCCESS: SMMR has the member foo smm_test.go:43: SUCCESS: SMMR has the member bar subtest.go:23: subtest.go:28: Subtest completed in 3.39s (excluding cleanup) --- PASS: TestSMMRAutoCreationAndDeletion/create_first_SMM (3.39s) === RUN TestSMMRAutoCreationAndDeletion/delete_non-terminal_SMM smm_test.go:52: This test verifies that the SMMR isn't deleted when one SMM is deleted, but other SMMs still exist smm_test.go:53: See https://issues.redhat.com/browse/OSSM-2374 (implementation) smm_test.go:54: See https://issues.redhat.com/browse/OSSM-3450 (test) smm_test.go:56: smm_test.go:56: STEP 1: Delete one SMM, but keep the other smm_test.go:59: smm_test.go:59: STEP 2: Check if SMMR becomes ready (it won't be if it gets deleted) subtest.go:23: subtest.go:28: Subtest completed in 0.69s (excluding cleanup) --- PASS: TestSMMRAutoCreationAndDeletion/delete_non-terminal_SMM (0.69s) === RUN TestSMMRAutoCreationAndDeletion/delete_terminal_SMM smm_test.go:66: This test verifies tht the SMMR is deleted when the last SMM is deleted smm_test.go:67: See https://issues.redhat.com/browse/OSSM-2374 (implementation) smm_test.go:68: See https://issues.redhat.com/browse/OSSM-3450 (test) smm_test.go:70: smm_test.go:70: STEP 1: Delete last SMM smm_test.go:73: smm_test.go:73: STEP 2: Check that SMMR is deleted smm_test.go:74: SUCCESS: SMMR has been deleted subtest.go:23: subtest.go:28: Subtest completed in 0.67s (excluding cleanup) --- PASS: TestSMMRAutoCreationAndDeletion/delete_terminal_SMM (0.67s) test.go:77: test.go:82: Test completed in 19.56s (excluding cleanup) smm_test.go:20: smm_test.go:20: Performing cleanup smm_test.go:20: Cleanup completed in 1.50s --- PASS: TestSMMRAutoCreationAndDeletion (21.06s) === RUN TestSmoke smoke_test.go:46: Smoke Test for SMCP: deploy, upgrade, bookinfo and uninstall smoke_test.go:56: Deleting namespaces: [istio-system] smoke_test.go:56: Creating namespaces: [istio-system] === RUN TestSmoke/upgrade_v2.2_to_v2.3 smoke_test.go:59: This test checks whether SMCP becomes ready after it's upgraded from v2.2 to v2.3 and bookinfo is still working after the upgrade and also test a clean installation of the target SMCP smoke_test.go:65: smoke_test.go:65: STEP 1: Install SMCP v2.2 and verify it becomes ready smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:68: smoke_test.go:68: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:69: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:69: Create Bookinfo Gateway smoke_test.go:69: Create Bookinfo Destination Rules (all) smoke_test.go:69: Create Bookinfo Deployments smoke_test.go:69: Install app "sleep" in namespace "bookinfo" smoke_test.go:69: Wait for app bookinfo/bookinfo to be ready smoke_test.go:69: Wait for app bookinfo/sleep to be ready smoke_test.go:71: smoke_test.go:71: STEP 5: Check if bookinfo traffic flows through the Proxy smoke_test.go:137: SUCCESS: ProductPage returns 200 OK smoke_test.go:137: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:137: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:74: smoke_test.go:74: STEP 6: Upgrade SMCP from v2.2 to v2.3 smoke_test.go:187: smoke_test.go:187: STEP 7: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 8: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:77: smoke_test.go:77: STEP 9: Check if bookinfo productpage is running through the Proxy after the upgrade smoke_test.go:137: SUCCESS: ProductPage returns 200 OK smoke_test.go:137: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:137: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:80: smoke_test.go:80: STEP 10: Delete Bookinfo pods to force the update of the sidecar smoke_test.go:125: smoke_test.go:125: STEP 11: Verify if all the routes are created smoke_test.go:196: Related issue: https://issues.redhat.com/browse/OSSM-4069 smoke_test.go:197: SUCCESS: Route grafana is created smoke_test.go:197: SUCCESS: Route istio-ingressgateway is created smoke_test.go:197: SUCCESS: Route jaeger is created smoke_test.go:197: SUCCESS: Route kiali is created smoke_test.go:197: SUCCESS: Route prometheus is created smoke_test.go:128: smoke_test.go:128: STEP 12: Check if bookinfo traffic flows through the Proxy smoke_test.go:137: SUCCESS: ProductPage returns 200 OK smoke_test.go:137: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:137: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:131: smoke_test.go:131: STEP 13: verify proxy startup time. Expected to be less than 10 seconds smoke_test.go:132: Jira related: https://issues.redhat.com/browse/OSSM-3586 smoke_test.go:157: Extracting proxy startup time and last transition time for all the pods in the namespace subtest.go:23: subtest.go:28: Subtest completed in 84.12s (excluding cleanup) smoke_test.go:60: smoke_test.go:60: Performing cleanup smoke_test.go:61: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:62: Deleting namespaces: [istio-system] smoke_test.go:62: Creating namespaces: [istio-system] smoke_test.go:60: Cleanup completed in 51.58s --- PASS: TestSmoke/upgrade_v2.2_to_v2.3 (135.71s) === RUN TestSmoke/install_smcp_v2.3 smoke_test.go:87: This test checks whether SMCP v2.3 install the SMCP version smoke_test.go:92: smoke_test.go:92: STEP 1: Install SMCP v2.3 smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:95: smoke_test.go:95: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:96: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:96: Create Bookinfo Gateway smoke_test.go:96: Create Bookinfo Destination Rules (all) smoke_test.go:96: Create Bookinfo Deployments smoke_test.go:96: Install app "sleep" in namespace "bookinfo" smoke_test.go:96: Wait for app bookinfo/bookinfo to be ready smoke_test.go:96: Wait for app bookinfo/sleep to be ready smoke_test.go:125: smoke_test.go:125: STEP 5: Verify if all the routes are created smoke_test.go:196: Related issue: https://issues.redhat.com/browse/OSSM-4069 smoke_test.go:197: SUCCESS: Route grafana is created smoke_test.go:197: SUCCESS: Route istio-ingressgateway is created smoke_test.go:197: SUCCESS: Route jaeger is created smoke_test.go:197: SUCCESS: Route kiali is created smoke_test.go:197: SUCCESS: Route prometheus is created smoke_test.go:128: smoke_test.go:128: STEP 6: Check if bookinfo traffic flows through the Proxy smoke_test.go:137: SUCCESS: ProductPage returns 200 OK smoke_test.go:137: SUCCESS: HTTP header 'server: istio-envoy' is present in the response smoke_test.go:137: SUCCESS: HTTP header 'x-envoy-decorator-operation' is present in the response smoke_test.go:131: smoke_test.go:131: STEP 7: verify proxy startup time. Expected to be less than 10 seconds smoke_test.go:132: Jira related: https://issues.redhat.com/browse/OSSM-3586 smoke_test.go:157: Extracting proxy startup time and last transition time for all the pods in the namespace subtest.go:23: subtest.go:28: Subtest completed in 69.31s (excluding cleanup) smoke_test.go:88: smoke_test.go:88: Performing cleanup smoke_test.go:89: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:88: Cleanup completed in 3.18s --- PASS: TestSmoke/install_smcp_v2.3 (72.49s) === RUN TestSmoke/delete_smcp_v2.3 smoke_test.go:102: This test checks whether SMCP v2.3 deletion deletes all the resources smoke_test.go:107: smoke_test.go:107: STEP 1: Delete SMCP and SMMR in namespace istio-system smoke_test.go:110: smoke_test.go:110: STEP 2: verify SMCP resources are deleted smoke_test.go:111: SUCCESS: SMCP resources are deleted subtest.go:23: subtest.go:28: Subtest completed in 33.30s (excluding cleanup) smoke_test.go:103: smoke_test.go:103: Performing cleanup smoke_test.go:104: Deleting namespaces: [istio-system] smoke_test.go:104: Creating namespaces: [istio-system] smoke_test.go:103: Cleanup completed in 22.51s --- PASS: TestSmoke/delete_smcp_v2.3 (55.81s) test.go:77: test.go:82: Test completed in 295.51s (excluding cleanup) smoke_test.go:49: smoke_test.go:49: Performing cleanup smoke_test.go:50: Deleting namespaces: [istio-system] smoke_test.go:50: Creating namespaces: [istio-system] smoke_test.go:49: Cleanup completed in 6.30s --- PASS: TestSmoke (301.80s) === RUN TestSSL testssl_test.go:45: testssl_test.go:45: STEP 1: Apply default SMCP and SMMR manifests testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:47: testssl_test.go:47: STEP 2: Patch SMCP to enable mTLS in dataPlane and controlPlane and set min/maxProtocolVersion, cipherSuites, and ecdhCurves testssl_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:64: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:66: testssl_test.go:66: STEP 3: Install bookinfo with mTLS and testssl pod testssl_test.go:68: Install app "bookinfo" in namespace "bookinfo" testssl_test.go:68: Create Bookinfo Gateway testssl_test.go:68: Create Bookinfo Destination Rules (all) testssl_test.go:68: Create Bookinfo Deployments testssl_test.go:68: Wait for app bookinfo/bookinfo to be ready testssl_test.go:71: testssl_test.go:71: STEP 4: Check testssl.sh results testssl_test.go:72: SUCCESS: Received the TLSv1.2 needed in the testssl.sh results testssl_test.go:72: SUCCESS: Results received the correct SHA256 testssl_test.go:72: SUCCESS: Results included: P-256 test.go:77: test.go:82: Test completed in 67.09s (excluding cleanup) testssl_test.go:31: testssl_test.go:31: Performing cleanup testssl_test.go:41: Uninstalling Bookinfo from namespace "bookinfo" testssl_test.go:31: Cleanup completed in 3.74s --- PASS: TestSSL (70.83s) FAIL FAIL github.com/maistra/maistra-test-tool/pkg/tests/ossm 1570.423s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestClusterWideMode test.go:117: This test is being skipped because it doesn't support the current SMCP version v2.3 (min version is v2.4) --- SKIP: TestClusterWideMode (0.00s) === RUN TestOperatorCanReconcileSMCPWhenIstiodOffline operator_deadlock_test.go:16: This test checks if the operator can reconcile an SMCP even if the istiod pod is missing operator_deadlock_test.go:17: See https://issues.redhat.com/browse/OSSM-3235 operator_deadlock_test.go:20: Skipped because OSSM-3235 is only fixed in 2.4+ test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestOperatorCanReconcileSMCPWhenIstiodOffline (0.00s) === RUN TestOperatorPodHonorsReadinessProbe test.go:117: This test is being skipped because it doesn't support the current SMCP version v2.3 (min version is v2.4) --- SKIP: TestOperatorPodHonorsReadinessProbe (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm/operator 1.294s === RUN TestMultiClusterFederationFailover federation_failover_test.go:41: this test only runs when the KUBECONFIG2 environment variable points to the kubeconfig of the second cluster test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestMultiClusterFederationFailover (0.00s) === RUN TestFederation federation_traffic_splitting_test.go:38: Both OC clusters are set respectively to cluster west and east if they are provided with two kubeconfig files, if not, both are set from the same file federation_common.go:63: federation_common.go:63: STEP 1: Create projects for west-mesh and east-mesh federation_common.go:64: Creating namespaces: [west-mesh-system west-mesh-bookinfo] federation_common.go:65: Creating namespaces: [east-mesh-system east-mesh-bookinfo] federation_common.go:67: federation_common.go:67: STEP 2: Install control planes for west-mesh and east-mesh federation_common.go:159: Install ServiceMeshControlPlane west-mesh in namespace west-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:159: Install ServiceMeshControlPlane east-mesh in namespace east-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:70: federation_common.go:70: STEP 3: Wait for west-mesh and east-mesh installation to complete federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: SUCCESS: Condition condition=Ready met by smcp west-mesh-system/west-mesh federation_common.go:72: Wait for condition condition=Ready on smcp east-mesh-system/east-mesh... federation_common.go:72: SUCCESS: Condition condition=Ready met by smcp east-mesh-system/east-mesh federation_common.go:74: federation_common.go:74: STEP 4: Retrieve peer addresses and ports federation_common.go:77: Using ClusterIP service for ingress federation_common.go:88: west-mesh: address: east-mesh-ingress.west-mesh-system.svc.cluster.local; discovery port: 8188, service port: 15443 federation_common.go:89: east-mesh: address: west-mesh-ingress.east-mesh-system.svc.cluster.local; discovery port: 8188, service port: 15443 federation_common.go:91: federation_common.go:91: STEP 5: Retrieve root certificates federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:95: federation_common.go:95: STEP 6: Install ServiceMeshPeer and ExportedServiceSet in west-mesh federation_common.go:100: federation_common.go:100: STEP 7: Install ServiceMeshPeer and ImportedServiceSet in east-mesh federation_traffic_splitting_test.go:111: federation_traffic_splitting_test.go:111: STEP 8: Install ratings-v2 and mongodb in west-mesh federation_traffic_splitting_test.go:117: federation_traffic_splitting_test.go:117: STEP 9: Install full bookinfo in east-mesh federation_common.go:107: federation_common.go:107: STEP 10: Wait for all bookinfo pods in west-mesh and east-mesh to be ready federation_common.go:111: federation_common.go:111: STEP 11: Check if west-mesh and east-mesh are connected to each other federation_common.go:112: SUCCESS: west-mesh is connected to east-mesh federation_common.go:112: SUCCESS: east-mesh is connected to west-mesh federation_traffic_splitting_test.go:129: federation_traffic_splitting_test.go:129: STEP 12: Check if traffic is split between ratings-v1 in east-mesh and west-mesh federation_traffic_splitting_test.go:131: federation_traffic_splitting_test.go:131: STEP 13: Check if east-mesh can see services from west-mesh federation_traffic_splitting_test.go:132: SUCCESS: mongodb service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:132: SUCCESS: ratings service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:156: SUCCESS: ratings-v2 in east-mesh received 3 requests federation_traffic_splitting_test.go:162: SUCCESS: ratings-v2 in west-mesh received 17 requests test.go:77: test.go:82: Test completed in 65.65s (excluding cleanup) federation_common.go:53: federation_common.go:53: Performing cleanup federation_common.go:56: Deleting namespaces: [west-mesh-system east-mesh-system west-mesh-bookinfo east-mesh-bookinfo] federation_common.go:53: Cleanup completed in 18.43s --- PASS: TestFederation (84.08s) === RUN TestFederationDifferentCerts federation_common.go:63: federation_common.go:63: STEP 1: Create projects for west-mesh and east-mesh federation_common.go:64: Creating namespaces: [west-mesh-system west-mesh-bookinfo] federation_common.go:65: Creating namespaces: [east-mesh-system east-mesh-bookinfo] federation_common.go:67: federation_common.go:67: STEP 2: Install control planes for west-mesh and east-mesh federation_traffic_splitting_test.go:84: Create Secret 'cacerts' for custom CA certs in west-mesh federation_common.go:159: Install ServiceMeshControlPlane west-mesh in namespace west-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:159: Install ServiceMeshControlPlane east-mesh in namespace east-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:70: federation_common.go:70: STEP 3: Wait for west-mesh and east-mesh installation to complete federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: SUCCESS: Condition condition=Ready met by smcp west-mesh-system/west-mesh federation_common.go:72: Wait for condition condition=Ready on smcp east-mesh-system/east-mesh... federation_common.go:72: SUCCESS: Condition condition=Ready met by smcp east-mesh-system/east-mesh federation_common.go:74: federation_common.go:74: STEP 4: Retrieve peer addresses and ports federation_common.go:77: Using ClusterIP service for ingress federation_common.go:88: west-mesh: address: east-mesh-ingress.west-mesh-system.svc.cluster.local; discovery port: 8188, service port: 15443 federation_common.go:89: east-mesh: address: west-mesh-ingress.east-mesh-system.svc.cluster.local; discovery port: 8188, service port: 15443 federation_common.go:91: federation_common.go:91: STEP 5: Retrieve root certificates federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:95: federation_common.go:95: STEP 6: Install ServiceMeshPeer and ExportedServiceSet in west-mesh federation_common.go:100: federation_common.go:100: STEP 7: Install ServiceMeshPeer and ImportedServiceSet in east-mesh federation_traffic_splitting_test.go:111: federation_traffic_splitting_test.go:111: STEP 8: Install ratings-v2 and mongodb in west-mesh federation_traffic_splitting_test.go:117: federation_traffic_splitting_test.go:117: STEP 9: Install full bookinfo in east-mesh federation_common.go:107: federation_common.go:107: STEP 10: Wait for all bookinfo pods in west-mesh and east-mesh to be ready federation_common.go:111: federation_common.go:111: STEP 11: Check if west-mesh and east-mesh are connected to each other federation_common.go:112: SUCCESS: west-mesh is connected to east-mesh federation_common.go:112: SUCCESS: east-mesh is connected to west-mesh federation_traffic_splitting_test.go:129: federation_traffic_splitting_test.go:129: STEP 12: Check if traffic is split between ratings-v1 in east-mesh and west-mesh federation_traffic_splitting_test.go:131: federation_traffic_splitting_test.go:131: STEP 13: Check if east-mesh can see services from west-mesh federation_traffic_splitting_test.go:132: SUCCESS: mongodb service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:132: SUCCESS: ratings service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:156: SUCCESS: ratings-v2 in east-mesh received 6 requests federation_traffic_splitting_test.go:162: SUCCESS: ratings-v2 in west-mesh received 12 requests test.go:77: test.go:82: Test completed in 64.38s (excluding cleanup) federation_common.go:53: federation_common.go:53: Performing cleanup federation_common.go:56: Deleting namespaces: [west-mesh-system east-mesh-system west-mesh-bookinfo east-mesh-bookinfo] federation_common.go:53: Cleanup completed in 19.18s --- PASS: TestFederationDifferentCerts (83.56s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm-federation 167.777s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestCustomPrometheus custom_prometheus_test.go:29: Extension providers are not supported in OSSM older than v2.4.0 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestCustomPrometheus (0.00s) === RUN TestOpenShiftMonitoring openshift_monitoring_test.go:41: integration with OpenShift Monitoring stack is not supported in OSSM older than v2.4.0 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestOpenShiftMonitoring (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/observability 1.597s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAuthPolicy auth_test.go:45: auth_test.go:45: STEP 1: Apply default SMCP and SMMR manifests auth_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... auth_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic auth_test.go:47: auth_test.go:47: STEP 2: Install httpbin and sleep in multiple namespaces auth_test.go:48: Install app "httpbin" in namespace "foo" auth_test.go:48: Install app "httpbin" in namespace "bar" auth_test.go:48: Install app "httpbin" in namespace "legacy" auth_test.go:48: Install app "sleep" in namespace "foo" auth_test.go:48: Install app "sleep" in namespace "bar" auth_test.go:48: Install app "sleep" in namespace "legacy" auth_test.go:48: Wait for app foo/httpbin to be ready auth_test.go:48: Wait for app bar/httpbin to be ready auth_test.go:48: Wait for app legacy/httpbin to be ready auth_test.go:48: Wait for app foo/sleep to be ready auth_test.go:48: Wait for app bar/sleep to be ready auth_test.go:48: Wait for app legacy/sleep to be ready auth_test.go:59: auth_test.go:59: STEP 3: Check connectivity from namespaces foo, bar, and legacy to namespaces foo and bar auth_test.go:60: SUCCESS: foo connects to foo auth_test.go:60: SUCCESS: foo connects to bar auth_test.go:60: SUCCESS: bar connects to foo auth_test.go:60: SUCCESS: bar connects to bar auth_test.go:60: SUCCESS: legacy connects to foo auth_test.go:60: SUCCESS: legacy connects to bar === RUN TestAuthPolicy/enable_auto_mTLS auth_test.go:69: auth_test.go:69: STEP 1: Check if mTLS is enabled in foo auth_test.go:70: SUCCESS: mTLS is enabled in namespace foo (X-Forwarded-Client-Cert header is present) auth_test.go:80: auth_test.go:80: STEP 2: Check that mTLS is NOT enabled in legacy auth_test.go:81: SUCCESS: mTLS is not enabled in namespace legacy (X-Forwarded-Client-Cert header is not present) subtest.go:23: subtest.go:28: Subtest completed in 1.91s (excluding cleanup) --- PASS: TestAuthPolicy/enable_auto_mTLS (1.91s) === RUN TestAuthPolicy/enable_global_mTLS_STRICT_mode auth_test.go:93: auth_test.go:93: STEP 1: Enable mTLS STRICT mode globally auth_test.go:99: SUCCESS: Global mTLS expected 000 auth_test.go:99: SUCCESS: Global mTLS expected 000 subtest.go:23: subtest.go:28: Subtest completed in 3.43s (excluding cleanup) auth_test.go:95: auth_test.go:95: Performing cleanup auth_test.go:95: Cleanup completed in 0.32s --- PASS: TestAuthPolicy/enable_global_mTLS_STRICT_mode (3.75s) === RUN TestAuthPolicy/namespace_policy_mtls auth_test.go:114: auth_test.go:114: STEP 1: Enable mutual TLS per namespace auth_test.go:119: SUCCESS: foo connects to foo auth_test.go:119: SUCCESS: foo connects to bar auth_test.go:119: SUCCESS: bar connects to foo auth_test.go:119: SUCCESS: bar connects to bar auth_test.go:119: SUCCESS: legacy can't conect to foo auth_test.go:119: SUCCESS: legacy connects to bar subtest.go:23: subtest.go:28: Subtest completed in 7.51s (excluding cleanup) auth_test.go:116: auth_test.go:116: Performing cleanup auth_test.go:116: Cleanup completed in 0.29s --- PASS: TestAuthPolicy/namespace_policy_mtls (7.80s) === RUN TestAuthPolicy/workload_policy_mtls auth_test.go:133: auth_test.go:133: STEP 1: Enable mutual TLS per workload auth_test.go:138: SUCCESS: legacy can't conect to bar auth_test.go:142: auth_test.go:142: STEP 2: Refine mutual TLS per port auth_test.go:144: SUCCESS: legacy connects to bar subtest.go:23: subtest.go:28: Subtest completed in 4.96s (excluding cleanup) auth_test.go:135: auth_test.go:135: Performing cleanup auth_test.go:135: Cleanup completed in 0.24s --- PASS: TestAuthPolicy/workload_policy_mtls (5.20s) === RUN TestAuthPolicy/policy_precedence_mtls auth_test.go:150: auth_test.go:150: STEP 1: Overwrite foo namespace policy by a workload policy auth_test.go:155: SUCCESS: legacy connects to foo subtest.go:23: subtest.go:28: Subtest completed in 2.44s (excluding cleanup) auth_test.go:152: auth_test.go:152: Performing cleanup auth_test.go:152: Cleanup completed in 0.27s --- PASS: TestAuthPolicy/policy_precedence_mtls (2.71s) === RUN TestAuthPolicy/end-user_JWT auth_test.go:164: End-user authentication auth_test.go:166: auth_test.go:166: STEP 1: Apply httpbin gateway auth_test.go:169: auth_test.go:169: STEP 2: Check httpbin request is successful auth_test.go:170: SUCCESS: received expected status code 200 auth_test.go:174: auth_test.go:174: STEP 3: Apply a JWT policy auth_test.go:180: auth_test.go:180: STEP 4: Check whether request without token returns 200 auth_test.go:181: SUCCESS: received expected status code 200 auth_test.go:185: auth_test.go:185: STEP 5: Check whether request with an invalid token returns 401 auth_test.go:186: SUCCESS: received expected status code 401 auth_test.go:190: auth_test.go:190: STEP 6: Check whether request with a valid token returns 200 auth_test.go:193: SUCCESS: received expected status code 200 subtest.go:23: subtest.go:28: Subtest completed in 5.41s (excluding cleanup) auth_test.go:176: auth_test.go:176: Performing cleanup auth_test.go:176: Cleanup completed in 0.16s --- PASS: TestAuthPolicy/end-user_JWT (5.57s) === RUN TestAuthPolicy/end-user_require_JWT auth_test.go:201: Require a valid token auth_test.go:207: SUCCESS: received expected status code 403 subtest.go:23: subtest.go:28: Subtest completed in 2.63s (excluding cleanup) auth_test.go:203: auth_test.go:203: Performing cleanup auth_test.go:203: Cleanup completed in 0.22s --- PASS: TestAuthPolicy/end-user_require_JWT (2.85s) === RUN TestAuthPolicy/end-user_require_JWT_per_path auth_test.go:213: Require valid tokens per-path auth_test.go:219: SUCCESS: received expected status code 403 auth_test.go:219: SUCCESS: received expected status code 200 subtest.go:23: subtest.go:28: Subtest completed in 2.59s (excluding cleanup) auth_test.go:215: auth_test.go:215: Performing cleanup auth_test.go:215: Cleanup completed in 0.20s --- PASS: TestAuthPolicy/end-user_require_JWT_per_path (2.80s) test.go:77: test.go:82: Test completed in 64.25s (excluding cleanup) auth_test.go:41: auth_test.go:41: Performing cleanup auth_test.go:42: Deleting namespaces: [foo bar legacy] auth_test.go:42: Creating namespaces: [foo bar legacy] auth_test.go:41: Cleanup completed in 17.32s --- PASS: TestAuthPolicy (81.57s) === RUN TestMTlsMigration mtls_migration_test.go:40: mtls_migration_test.go:40: STEP 1: Apply default SMCP and SMMR manifests mtls_migration_test.go:40: Wait for condition condition=Ready on smcp istio-system/basic... mtls_migration_test.go:40: SUCCESS: Condition condition=Ready met by smcp istio-system/basic mtls_migration_test.go:42: mtls_migration_test.go:42: STEP 2: Install httpbin and sleep in multiple namespaces mtls_migration_test.go:43: Install app "httpbin" in namespace "foo" mtls_migration_test.go:43: Install app "httpbin" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "foo" mtls_migration_test.go:43: Install app "sleep" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "legacy" mtls_migration_test.go:43: Wait for app foo/httpbin to be ready mtls_migration_test.go:43: Wait for app bar/httpbin to be ready mtls_migration_test.go:43: Wait for app foo/sleep to be ready mtls_migration_test.go:43: Wait for app bar/sleep to be ready mtls_migration_test.go:43: Wait for app legacy/sleep to be ready mtls_migration_test.go:53: mtls_migration_test.go:53: STEP 3: Check connectivity from namespaces foo, bar, and legacy to namespace foo and bar mtls_migration_test.go:54: SUCCESS: foo connects to foo mtls_migration_test.go:54: SUCCESS: foo connects to bar mtls_migration_test.go:54: SUCCESS: bar connects to foo mtls_migration_test.go:54: SUCCESS: bar connects to bar mtls_migration_test.go:54: SUCCESS: legacy connects to foo mtls_migration_test.go:54: SUCCESS: legacy connects to bar === RUN TestMTlsMigration/mTLS_enabled_in_foo mtls_migration_test.go:63: mtls_migration_test.go:63: STEP 1: Apply strict mTLS in namespace foo mtls_migration_test.go:66: mtls_migration_test.go:66: STEP 2: Check connectivity from namespaces foo, bar, and legacy to namespace foo and bar (expect failure only from legacy to foo) mtls_migration_test.go:67: SUCCESS: foo connects to foo mtls_migration_test.go:67: SUCCESS: foo connects to bar mtls_migration_test.go:67: SUCCESS: bar connects to foo mtls_migration_test.go:67: SUCCESS: bar connects to bar mtls_migration_test.go:67: SUCCESS: legacy can't conect to foo mtls_migration_test.go:67: SUCCESS: legacy connects to bar subtest.go:23: subtest.go:28: Subtest completed in 6.78s (excluding cleanup) --- PASS: TestMTlsMigration/mTLS_enabled_in_foo (6.78s) === RUN TestMTlsMigration/mTLS_enabled_globally mtls_migration_test.go:81: mtls_migration_test.go:81: STEP 1: Apply strict mTLS for the entire mesh mtls_migration_test.go:87: mtls_migration_test.go:87: STEP 2: Check connectivity from namespaces foo, bar, and legacy to namespace foo and bar (expect failure from legacy) mtls_migration_test.go:88: SUCCESS: foo connects to foo mtls_migration_test.go:88: SUCCESS: foo connects to bar mtls_migration_test.go:88: SUCCESS: bar connects to foo mtls_migration_test.go:88: SUCCESS: bar connects to bar mtls_migration_test.go:88: SUCCESS: legacy can't conect to foo mtls_migration_test.go:88: SUCCESS: legacy can't conect to bar subtest.go:23: subtest.go:28: Subtest completed in 7.09s (excluding cleanup) mtls_migration_test.go:83: mtls_migration_test.go:83: Performing cleanup mtls_migration_test.go:83: Cleanup completed in 0.35s --- PASS: TestMTlsMigration/mTLS_enabled_globally (7.44s) test.go:77: test.go:82: Test completed in 44.79s (excluding cleanup) mtls_migration_test.go:36: mtls_migration_test.go:36: Performing cleanup mtls_migration_test.go:37: Deleting namespaces: [foo bar legacy] mtls_migration_test.go:37: Creating namespaces: [foo bar legacy] mtls_migration_test.go:36: Cleanup completed in 15.90s --- PASS: TestMTlsMigration (60.69s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/authentication 143.835s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAuthorizationDenyAllow deny_test.go:33: This test validates authorization policies with a deny action deny_test.go:35: deny_test.go:35: STEP 1: Apply default SMCP and SMMR manifests deny_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... deny_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic deny_test.go:37: deny_test.go:37: STEP 2: Install httpbin and sleep deny_test.go:38: Install app "httpbin" in namespace "foo" deny_test.go:38: Install app "sleep" in namespace "foo" deny_test.go:38: Wait for app foo/httpbin to be ready deny_test.go:38: Wait for app foo/sleep to be ready deny_test.go:40: deny_test.go:40: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place deny_test.go:41: SUCCESS: Got expected 200 OK from httpbin === RUN TestAuthorizationDenyAllow/explicitly_deny_request deny_test.go:47: deny_test.go:47: STEP 1: Apply policy that denies all GET requests to httpbin deny_test.go:50: deny_test.go:50: STEP 2: Verify that GET request is denied deny_test.go:51: SUCCESS: Got the expected 403 response code deny_test.go:53: deny_test.go:53: STEP 3: Verify that POST request is allowed deny_test.go:54: SUCCESS: Got the expected 200 OK response for request from httpbin subtest.go:23: subtest.go:28: Subtest completed in 2.92s (excluding cleanup) deny_test.go:44: deny_test.go:44: Performing cleanup deny_test.go:44: Cleanup completed in 0.21s --- PASS: TestAuthorizationDenyAllow/explicitly_deny_request (3.13s) === RUN TestAuthorizationDenyAllow/deny_request_header deny_test.go:61: deny_test.go:61: STEP 1: Apply policy that denies GET requests unless the HTTP header 'x-token: admin' is present deny_test.go:64: deny_test.go:64: STEP 2: Verify that GET request with HTTP header 'x-token: admin' is allowed deny_test.go:65: SUCCESS: Got the expected 200 OK response for request from httpbin deny_test.go:67: deny_test.go:67: STEP 3: Verify that GET request with HTTP header 'x-token: guest' is denied deny_test.go:68: SUCCESS: Got the expected 403 response code subtest.go:23: subtest.go:28: Subtest completed in 4.87s (excluding cleanup) deny_test.go:58: deny_test.go:58: Performing cleanup deny_test.go:58: Cleanup completed in 0.28s --- PASS: TestAuthorizationDenyAllow/deny_request_header (5.15s) === RUN TestAuthorizationDenyAllow/allow_request_path deny_test.go:76: deny_test.go:76: STEP 1: Apply policy that denies GET requests unless the HTTP header 'x-token: admin' is present deny_test.go:79: deny_test.go:79: STEP 2: Apply policy that allows requests with the path '/ip' deny_test.go:82: deny_test.go:82: STEP 3: Verify that GET request with the HTTP header 'x-token: guest' at path '/ip' is denied deny_test.go:83: SUCCESS: Got the expected 403 response code deny_test.go:85: deny_test.go:85: STEP 4: Verify that GET request with HTTP header 'x-token: admin' at path '/ip' is allowed deny_test.go:86: SUCCESS: Got the expected 200 OK response for request from httpbin deny_test.go:88: deny_test.go:88: STEP 5: Verify that GET request with HTTP header 'x-token: admin' at path '/get' is denied deny_test.go:89: SUCCESS: Got the expected 403 response code subtest.go:23: subtest.go:28: Subtest completed in 8.05s (excluding cleanup) deny_test.go:72: deny_test.go:72: Performing cleanup deny_test.go:72: Cleanup completed in 0.58s --- PASS: TestAuthorizationDenyAllow/allow_request_path (8.63s) test.go:77: test.go:82: Test completed in 37.70s (excluding cleanup) deny_test.go:29: deny_test.go:29: Performing cleanup deny_test.go:30: Deleting namespaces: [foo] deny_test.go:30: Creating namespaces: [foo] deny_test.go:29: Cleanup completed in 15.26s --- PASS: TestAuthorizationDenyAllow (52.96s) === RUN TestEnvoyExtAuthzHttpExtensionProvider ext_auth_test.go:33: This test validates authorization policies with a JWT Token ext_auth_test.go:37: ext_auth_test.go:37: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:39: ext_auth_test.go:39: STEP 2: Install httpbin and sleep ext_auth_test.go:40: Install app "httpbin" in namespace "foo" ext_auth_test.go:40: Install app "sleep" in namespace "foo" ext_auth_test.go:40: Wait for app foo/httpbin to be ready ext_auth_test.go:40: Wait for app foo/sleep to be ready ext_auth_test.go:45: ext_auth_test.go:45: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place ext_auth_test.go:46: SUCCESS: Got expected 200 OK from httpbin ext_auth_test.go:48: ext_auth_test.go:48: STEP 4: Deploy the External Authorizer and Verify the sample external authorizer is up and running ext_auth_test.go:56: ext_auth_test.go:56: STEP 5: Set envoyExtAuthzHttp extension provider in SMCP ext_auth_test.go:93: ext_auth_test.go:93: STEP 6: Deploy the external authorization in the Authorization policy ext_auth_test.go:99: ext_auth_test.go:99: STEP 7: Verify a request to path /headers with header x-ext-authz: deny is denied by the sample ext_authz server: ext_auth_test.go:100: SUCCESS: Got the expected 403 response code ext_auth_test.go:102: ext_auth_test.go:102: STEP 8: Verify a request to path /headers with header x-ext-authz: allow is allowed by the sample ext_authz server ext_auth_test.go:103: SUCCESS: Got the expected 200 OK response for request from httpbin ext_auth_test.go:105: ext_auth_test.go:105: STEP 9: Verify a request to path /ip is allowed and does not trigger the external authorization ext_auth_test.go:106: SUCCESS: Got expected 200 OK from httpbin test.go:77: test.go:82: Test completed in 33.42s (excluding cleanup) ext_auth_test.go:94: ext_auth_test.go:94: Performing cleanup ext_auth_test.go:94: Cleanup completed in 0.23s ext_auth_test.go:70: ext_auth_test.go:70: Performing cleanup ext_auth_test.go:70: Cleanup completed in 0.35s ext_auth_test.go:50: ext_auth_test.go:50: Performing cleanup ext_auth_test.go:50: Cleanup completed in 0.27s ext_auth_test.go:41: ext_auth_test.go:41: Performing cleanup ext_auth_test.go:41: Cleanup completed in 0.92s --- PASS: TestEnvoyExtAuthzHttpExtensionProvider (35.19s) === RUN TestEnvoyExtAuthzGrpcExtensionProvider ext_auth_test.go:115: This test validates authorization policies with a JWT Token ext_auth_test.go:119: ext_auth_test.go:119: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:119: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:119: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:121: ext_auth_test.go:121: STEP 2: Install httpbin and sleep ext_auth_test.go:122: Install app "httpbin" in namespace "foo" ext_auth_test.go:122: Install app "sleep" in namespace "foo" ext_auth_test.go:122: Wait for app foo/httpbin to be ready ext_auth_test.go:122: Wait for app foo/sleep to be ready ext_auth_test.go:127: ext_auth_test.go:127: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place ext_auth_test.go:128: SUCCESS: Got expected 200 OK from httpbin ext_auth_test.go:130: ext_auth_test.go:130: STEP 4: Deploy the External Authorizer and Verify the sample external authorizer is up and running ext_auth_test.go:138: ext_auth_test.go:138: STEP 5: Set envoyExtAuthzgRPC extension provider in SMCP ext_auth_test.go:159: ext_auth_test.go:159: STEP 6: Deploy the external authorization in the Authorization policy ext_auth_test.go:165: ext_auth_test.go:165: STEP 7: Verify a request to path /headers with header x-ext-authz: deny is denied by the sample ext_authz server: ext_auth_test.go:166: SUCCESS: Got the expected 403 response code ext_auth_test.go:168: ext_auth_test.go:168: STEP 8: Verify a request to path /headers with header x-ext-authz: allow is allowed by the sample ext_authz server ext_auth_test.go:169: SUCCESS: Got the expected 200 OK response for request from httpbin ext_auth_test.go:171: ext_auth_test.go:171: STEP 9: Verify a request to path /ip is allowed and does not trigger the external authorization ext_auth_test.go:172: SUCCESS: Got expected 200 OK from httpbin test.go:77: test.go:82: Test completed in 30.98s (excluding cleanup) ext_auth_test.go:160: ext_auth_test.go:160: Performing cleanup ext_auth_test.go:160: Cleanup completed in 0.24s ext_auth_test.go:152: ext_auth_test.go:152: Performing cleanup ext_auth_test.go:152: Cleanup completed in 0.37s ext_auth_test.go:132: ext_auth_test.go:132: Performing cleanup ext_auth_test.go:132: Cleanup completed in 0.35s ext_auth_test.go:123: ext_auth_test.go:123: Performing cleanup ext_auth_test.go:123: Cleanup completed in 1.12s --- PASS: TestEnvoyExtAuthzGrpcExtensionProvider (33.05s) === RUN TestAuthorizationHTTPTraffic http_test.go:42: This test validates authorization policies for HTTP traffic. http_test.go:43: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-http/ http_test.go:45: http_test.go:45: STEP 1: Apply default SMCP and SMMR manifests http_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:47: http_test.go:47: STEP 2: Enable Service Mesh Control Plane mTLS http_test.go:53: http_test.go:53: STEP 3: Install bookinfo with mTLS http_test.go:54: Install app "bookinfo" in namespace "bookinfo" http_test.go:54: Create Bookinfo Gateway http_test.go:54: Create Bookinfo Destination Rules (all) http_test.go:54: Create Bookinfo Deployments http_test.go:54: Wait for app bookinfo/bookinfo to be ready http_test.go:55: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:55: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestAuthorizationHTTPTraffic/deny_all_http_traffic_to_bookinfo http_test.go:63: http_test.go:63: STEP 1: Apply policy that denies all HTTP requests to bookinfo workloads http_test.go:66: http_test.go:66: STEP 2: Verify that GET request is denied http_test.go:67: SUCCESS: string 'RBAC: access denied' found in response subtest.go:23: subtest.go:28: Subtest completed in 3.08s (excluding cleanup) http_test.go:60: http_test.go:60: Performing cleanup http_test.go:60: Cleanup completed in 0.16s --- PASS: TestAuthorizationHTTPTraffic/deny_all_http_traffic_to_bookinfo (3.24s) === RUN TestAuthorizationHTTPTraffic/only_allow_HTTP_GET_request_to_the_productpage_workload http_test.go:81: http_test.go:81: STEP 1: Apply policies that allow access with GET method to the productpage workload and deny requests to other workloads http_test.go:85: http_test.go:85: STEP 2: Verify that GET request to the productpage is allowed and fetching other services is denied http_test.go:86: SUCCESS: string 'Error fetching product details' found in response http_test.go:86: SUCCESS: string 'Error fetching product reviews' found in response subtest.go:23: subtest.go:28: Subtest completed in 5.26s (excluding cleanup) http_test.go:77: http_test.go:77: Performing cleanup http_test.go:77: Cleanup completed in 0.61s --- PASS: TestAuthorizationHTTPTraffic/only_allow_HTTP_GET_request_to_the_productpage_workload (5.87s) === RUN TestAuthorizationHTTPTraffic/allow_HTTP_GET_requests_to_all_bookinfo_workloads http_test.go:104: http_test.go:104: STEP 1: Apply policies that allow HTTP GET requests to all bookinfo workloads http_test.go:111: http_test.go:111: STEP 2: Verify that GET requests are allowed to all bookinfo workloads http_test.go:112: SUCCESS: string 'RBAC: access denied' not found in response http_test.go:112: SUCCESS: string 'Error fetching product details' not found in response http_test.go:112: SUCCESS: string 'Error fetching product reviews' not found in response http_test.go:112: SUCCESS: string 'Ratings service currently unavailable' not found in response subtest.go:23: subtest.go:28: Subtest completed in 8.52s (excluding cleanup) http_test.go:97: http_test.go:97: Performing cleanup http_test.go:97: Cleanup completed in 1.27s --- PASS: TestAuthorizationHTTPTraffic/allow_HTTP_GET_requests_to_all_bookinfo_workloads (9.79s) test.go:77: test.go:82: Test completed in 50.17s (excluding cleanup) http_test.go:33: http_test.go:33: Performing cleanup http_test.go:38: Deleting namespaces: [bookinfo] http_test.go:38: Creating namespaces: [bookinfo] http_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:39: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:33: Cleanup completed in 27.24s --- PASS: TestAuthorizationHTTPTraffic (77.41s) === RUN TestAuthorizationJWT jwt_test.go:35: This test validates authorization policies with JWT Token jwt_test.go:37: jwt_test.go:37: STEP 1: Apply default SMCP and SMMR manifests jwt_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... jwt_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic jwt_test.go:39: jwt_test.go:39: STEP 2: Install httpbin and sleep jwt_test.go:40: Install app "httpbin" in namespace "foo" jwt_test.go:40: Install app "sleep" in namespace "foo" jwt_test.go:40: Wait for app foo/httpbin to be ready jwt_test.go:40: Wait for app foo/sleep to be ready jwt_test.go:42: jwt_test.go:42: STEP 3: Check if httpbin returns 200 OK when no authorization policies are in place jwt_test.go:43: SUCCESS: Got expected 200 OK from httpbin === RUN TestAuthorizationJWT/Allow_requests_with_valid_JWT_and_list-typed_claims jwt_test.go:57: jwt_test.go:57: STEP 1: Verify that a request with an invalid JWT is denied jwt_test.go:58: SUCCESS: Got the expected 401 response code jwt_test.go:60: jwt_test.go:60: STEP 2: Verify that a request without a JWT is allowed because there is no authorization policy jwt_test.go:61: SUCCESS: Got the expected 200 OK response for request from httpbin subtest.go:23: subtest.go:28: Subtest completed in 3.79s (excluding cleanup) --- PASS: TestAuthorizationJWT/Allow_requests_with_valid_JWT_and_list-typed_claims (3.79s) === RUN TestAuthorizationJWT/Security_authorization_allow_JWT_requestPrincipal jwt_test.go:69: jwt_test.go:69: STEP 1: Verify that a request with a valid JWT is allowed jwt_test.go:70: SUCCESS: Got the expected 200 OK response for request from httpbin jwt_test.go:72: jwt_test.go:72: STEP 2: Verify request without a JWT is denied jwt_test.go:73: SUCCESS: Got the expected 403 response code subtest.go:23: subtest.go:28: Subtest completed in 5.28s (excluding cleanup) jwt_test.go:65: jwt_test.go:65: Performing cleanup jwt_test.go:65: Cleanup completed in 0.33s --- PASS: TestAuthorizationJWT/Security_authorization_allow_JWT_requestPrincipal (5.61s) === RUN TestAuthorizationJWT/Security_authorization_allow_JWT_claims_group jwt_test.go:81: jwt_test.go:81: STEP 1: Verify that a request with the JWT that includes group1 in the groups claim is allowed jwt_test.go:82: SUCCESS: Got the expected 200 OK response for request from httpbin jwt_test.go:84: jwt_test.go:84: STEP 2: Verify that a request with a JWT, which does not have the groups claim is rejected jwt_test.go:85: SUCCESS: Got the expected 403 response code subtest.go:23: subtest.go:28: Subtest completed in 3.26s (excluding cleanup) jwt_test.go:77: jwt_test.go:77: Performing cleanup jwt_test.go:77: Cleanup completed in 0.25s --- PASS: TestAuthorizationJWT/Security_authorization_allow_JWT_claims_group (3.51s) test.go:77: test.go:82: Test completed in 36.26s (excluding cleanup) jwt_test.go:51: jwt_test.go:51: Performing cleanup jwt_test.go:51: Cleanup completed in 0.31s jwt_test.go:31: jwt_test.go:31: Performing cleanup jwt_test.go:32: Deleting namespaces: [foo] jwt_test.go:32: Creating namespaces: [foo] jwt_test.go:31: Cleanup completed in 15.98s --- PASS: TestAuthorizationJWT (52.56s) === RUN TestAuthorizationTCPTraffic tcp_test.go:38: This test validates authorization policies for TCP traffic. tcp_test.go:39: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-tcp/ tcp_test.go:41: tcp_test.go:41: STEP 1: Apply default SMCP and SMMR manifests tcp_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... tcp_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic tcp_test.go:43: tcp_test.go:43: STEP 2: Install sleep and echo tcp_test.go:44: Install app "sleep" in namespace "foo" tcp_test.go:44: Install app "echo" in namespace "foo" tcp_test.go:44: Wait for app foo/sleep to be ready tcp_test.go:44: Wait for app foo/echo to be ready tcp_test.go:47: tcp_test.go:47: STEP 3: Verify sleep to echo TCP connections tcp_test.go:48: SUCCESS: Got expected hello message on port 9000 tcp_test.go:48: SUCCESS: Got expected hello message on port 9001 tcp_test.go:53: SUCCESS: Got expected hello message on port 9002 === RUN TestAuthorizationTCPTraffic/TCP_ALLOW_policy tcp_test.go:61: tcp_test.go:61: STEP 1: Apply a policy to allow tcp requests to port 9000 and 9001 tcp_test.go:64: SUCCESS: Got expected hello message on port 9000 tcp_test.go:64: SUCCESS: Got expected hello message on port 9001 tcp_test.go:69: SUCCESS: Got expected connection rejected on port 9002 subtest.go:23: subtest.go:28: Subtest completed in 9.80s (excluding cleanup) tcp_test.go:58: tcp_test.go:58: Performing cleanup tcp_test.go:58: Cleanup completed in 0.27s --- PASS: TestAuthorizationTCPTraffic/TCP_ALLOW_policy (10.08s) === RUN TestAuthorizationTCPTraffic/TCP_invalid_policy tcp_test.go:78: tcp_test.go:78: STEP 1: Apply an invalid policy to allow requests to port 9000 and add an HTTP GET field tcp_test.go:81: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:81: SUCCESS: Got expected connection rejected on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 4.71s (excluding cleanup) tcp_test.go:75: tcp_test.go:75: Performing cleanup tcp_test.go:75: Cleanup completed in 0.25s --- PASS: TestAuthorizationTCPTraffic/TCP_invalid_policy (4.96s) === RUN TestAuthorizationTCPTraffic/TCP_deny_policy tcp_test.go:91: tcp_test.go:91: STEP 1: Apply a policy to deny tcp requests to port 9000 tcp_test.go:94: SUCCESS: Got expected connection rejected on port 9000 tcp_test.go:94: SUCCESS: Got expected hello message on port 9001 subtest.go:23: subtest.go:28: Subtest completed in 5.66s (excluding cleanup) tcp_test.go:88: tcp_test.go:88: Performing cleanup tcp_test.go:88: Cleanup completed in 0.34s --- PASS: TestAuthorizationTCPTraffic/TCP_deny_policy (6.00s) test.go:77: test.go:82: Test completed in 46.10s (excluding cleanup) tcp_test.go:34: tcp_test.go:34: Performing cleanup tcp_test.go:35: Deleting namespaces: [foo] tcp_test.go:35: Creating namespaces: [foo] tcp_test.go:34: Cleanup completed in 15.21s --- PASS: TestAuthorizationTCPTraffic (61.31s) === RUN TestTrustDomainMigration trust_domain_test.go:49: trust_domain_test.go:49: STEP 1: Apply default SMCP and SMMR manifests trust_domain_test.go:49: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:49: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:96: Configure spec.security.trust.domain to "old-td" and alias "" trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:53: Install app "httpbin" in namespace "foo" trust_domain_test.go:53: Install app "sleep" in namespace "foo" trust_domain_test.go:53: Install app "sleep" in namespace "bar" trust_domain_test.go:53: Wait for app foo/httpbin to be ready trust_domain_test.go:53: Wait for app foo/sleep to be ready trust_domain_test.go:53: Wait for app bar/sleep to be ready trust_domain_test.go:58: Apply deny all policy except sleep in bar namespace === RUN TestTrustDomainMigration/Case_1:_Verifying_policy_works trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:86: SUCCESS: string '403' found in output trust_domain_test.go:85: Verifying curl output, expecting 200 trust_domain_test.go:86: SUCCESS: string '200' found in output subtest.go:23: subtest.go:28: Subtest completed in 2.00s (excluding cleanup) --- PASS: TestTrustDomainMigration/Case_1:_Verifying_policy_works (2.00s) === RUN TestTrustDomainMigration/Case_2:_Migrate_trust_domain_without_trust_domain_aliases trust_domain_test.go:96: Configure spec.security.trust.domain to "new-td" and alias "" trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:86: SUCCESS: string '403' found in output trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:86: SUCCESS: string '403' found in output subtest.go:23: subtest.go:28: Subtest completed in 26.66s (excluding cleanup) --- PASS: TestTrustDomainMigration/Case_2:_Migrate_trust_domain_without_trust_domain_aliases (26.66s) === RUN TestTrustDomainMigration/Case_3:_Migrate_trust_domain_with_trust_domain_aliases trust_domain_test.go:96: Configure spec.security.trust.domain to "new-td" and alias "old-td" trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: Wait for condition condition=Ready on smcp istio-system/basic... trust_domain_test.go:112: SUCCESS: Condition condition=Ready met by smcp istio-system/basic trust_domain_test.go:85: Verifying curl output, expecting 403 trust_domain_test.go:86: SUCCESS: string '403' found in output trust_domain_test.go:85: Verifying curl output, expecting 200 trust_domain_test.go:86: SUCCESS: string '200' found in output subtest.go:23: subtest.go:28: Subtest completed in 24.88s (excluding cleanup) --- PASS: TestTrustDomainMigration/Case_3:_Migrate_trust_domain_with_trust_domain_aliases (24.88s) test.go:77: test.go:82: Test completed in 91.34s (excluding cleanup) trust_domain_test.go:39: trust_domain_test.go:39: Performing cleanup trust_domain_test.go:39: Cleanup completed in 2.25s --- PASS: TestTrustDomainMigration (93.59s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/authorization 407.381s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestExternalCertificate external_ca_test.go:48: external_ca_test.go:48: STEP 1: Uninstall existing SMCP external_ca_test.go:49: Deleting namespaces: [istio-system] external_ca_test.go:49: Creating namespaces: [istio-system] external_ca_test.go:51: external_ca_test.go:51: STEP 2: Create cacerts secret external_ca_test.go:60: external_ca_test.go:60: STEP 3: Apply SMCP to configure certificate authority to use cacerts secret external_ca_test.go:62: Wait for condition condition=Ready on smcp istio-system/basic... external_ca_test.go:62: Wait for condition condition=Ready on smcp istio-system/basic... external_ca_test.go:62: SUCCESS: Condition condition=Ready met by smcp istio-system/basic external_ca_test.go:64: external_ca_test.go:64: STEP 4: Install bookinfo external_ca_test.go:65: Install app "bookinfo" in namespace "bookinfo" external_ca_test.go:65: Create Bookinfo Gateway external_ca_test.go:65: Create Bookinfo Destination Rules (all) external_ca_test.go:65: Create Bookinfo Deployments external_ca_test.go:65: Wait for app bookinfo/bookinfo to be ready external_ca_test.go:67: external_ca_test.go:67: STEP 5: Wait for response from productpage app external_ca_test.go:68: SUCCESS: received expected status code 200 external_ca_test.go:74: external_ca_test.go:74: STEP 6: Retrieve certificates from bookinfo details service external_ca_test.go:86: SUCCESS: The cert-chain certificates are present in the certificates sent by the tested service external_ca_test.go:90: SUCCESS: Certificate trust chain successfully verified test.go:77: test.go:82: Test completed in 117.00s (excluding cleanup) external_ca_test.go:37: external_ca_test.go:37: Performing cleanup external_ca_test.go:38: Recreate namespace bookinfo external_ca_test.go:39: Deleting namespaces: [bookinfo istio-system] external_ca_test.go:39: Creating namespaces: [bookinfo istio-system] external_ca_test.go:37: Cleanup completed in 16.79s --- PASS: TestExternalCertificate (133.80s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/certificate 135.101s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestIstioCsr istio_csr_test.go:31: istio-csr is not supported in SMCP older than v2.4 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestIstioCsr (0.00s) === RUN TestPluginCaCert plugin_ca_test.go:30: istio-csr is not supported in SMCP older than v2.4 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) --- SKIP: TestPluginCaCert (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/certmanager 1.795s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestCircuitBreaking circuit_breaking_test.go:37: This test checks whether the circuit breaker functions correctly. Check documentation: https://istio.io/latest/docs/tasks/traffic-management/circuit-breaking/ circuit_breaking_test.go:44: circuit_breaking_test.go:44: STEP 1: Apply default SMCP and SMMR manifests circuit_breaking_test.go:44: Wait for condition condition=Ready on smcp istio-system/basic... circuit_breaking_test.go:44: Wait for condition condition=Ready on smcp istio-system/basic... circuit_breaking_test.go:44: SUCCESS: Condition condition=Ready met by smcp istio-system/basic circuit_breaking_test.go:46: circuit_breaking_test.go:46: STEP 2: Install httpbin and fortio circuit_breaking_test.go:47: Install app "httpbin" in namespace "bookinfo" circuit_breaking_test.go:47: Install app "fortio" in namespace "bookinfo" circuit_breaking_test.go:47: Wait for app bookinfo/httpbin to be ready circuit_breaking_test.go:47: Wait for app bookinfo/fortio to be ready circuit_breaking_test.go:49: circuit_breaking_test.go:49: STEP 3: Configure circuit breaker destination rule circuit_breaking_test.go:52: circuit_breaking_test.go:52: STEP 4: Verify connection with curl: expect 200 OK circuit_breaking_test.go:53: SUCCESS: Got expected 200 OK response from httpbin circuit_breaking_test.go:66: circuit_breaking_test.go:66: STEP 5: Trip the circuit breaker by sending 50 requests to httpbin with 2 connections circuit_breaking_test.go:67: We expect request with response code 503 circuit_breaking_test.go:85: circuit_breaking_test.go:85: STEP 6: Validate the circuit breaker is tripped by checking the istio-proxy log circuit_breaking_test.go:122: SUCCESS: Found Upstream_rq_pending_overflow : 23 circuit_breaking_test.go:68: Success rate 200: 54% circuit_breaking_test.go:68: Success rate 503: 46% circuit_breaking_test.go:68: Verify istio-proxy pilot-agent stats, expected upstream_rq_pending_overflow value to be more than zero test.go:77: test.go:82: Test completed in 37.95s (excluding cleanup) circuit_breaking_test.go:40: circuit_breaking_test.go:40: Performing cleanup circuit_breaking_test.go:41: Deleting namespaces: [bookinfo] circuit_breaking_test.go:41: Creating namespaces: [bookinfo] circuit_breaking_test.go:40: Cleanup completed in 21.51s --- PASS: TestCircuitBreaking (59.46s) === RUN TestFaultInjection fault_injection_test.go:47: fault_injection_test.go:47: STEP 1: Apply default SMCP and SMMR manifests fault_injection_test.go:47: Wait for condition condition=Ready on smcp istio-system/basic... fault_injection_test.go:47: SUCCESS: Condition condition=Ready met by smcp istio-system/basic fault_injection_test.go:49: fault_injection_test.go:49: STEP 2: Install Bookinfo fault_injection_test.go:50: Install app "bookinfo" in namespace "bookinfo" fault_injection_test.go:50: Create Bookinfo Gateway fault_injection_test.go:50: Create Bookinfo Destination Rules (all) fault_injection_test.go:50: Create Bookinfo Deployments fault_injection_test.go:50: Wait for app bookinfo/bookinfo to be ready fault_injection_test.go:52: Logging into bookinfo as "jason" === RUN TestFaultInjection/ratings-fault-delay fault_injection_test.go:60: fault_injection_test.go:60: STEP 1: check if productpage shows 'error fetching product reviews' due to delay injection fault_injection_test.go:61: SUCCESS: request completed in 6.17s, which is within the expected range 4s - 14s fault_injection_test.go:61: SUCCESS: productpage shows 'error fetching product reviews', which is expected subtest.go:23: subtest.go:28: Subtest completed in 7.67s (excluding cleanup) --- PASS: TestFaultInjection/ratings-fault-delay (7.67s) === RUN TestFaultInjection/ratings-fault-abort fault_injection_test.go:77: fault_injection_test.go:77: STEP 1: check if productpage shows ratings service as unavailable due to abort injection fault_injection_test.go:78: SUCCESS: productpage shows 'ratings service is currently unavailable' as expected subtest.go:23: subtest.go:28: Subtest completed in 2.17s (excluding cleanup) --- PASS: TestFaultInjection/ratings-fault-abort (2.17s) test.go:77: test.go:82: Test completed in 39.63s (excluding cleanup) fault_injection_test.go:43: fault_injection_test.go:43: Performing cleanup fault_injection_test.go:44: Deleting namespaces: [bookinfo] fault_injection_test.go:44: Creating namespaces: [bookinfo] fault_injection_test.go:43: Cleanup completed in 22.49s --- PASS: TestFaultInjection (62.12s) === RUN TestRequestRouting request_routing_test.go:37: request_routing_test.go:37: STEP 1: Apply default SMCP and SMMR manifests request_routing_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... request_routing_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic request_routing_test.go:39: request_routing_test.go:39: STEP 2: Install Bookinfo request_routing_test.go:40: Install app "bookinfo" in namespace "bookinfo" request_routing_test.go:40: Create Bookinfo Gateway request_routing_test.go:40: Create Bookinfo Destination Rules (all) request_routing_test.go:40: Create Bookinfo Deployments request_routing_test.go:40: Wait for app bookinfo/bookinfo to be ready request_routing_test.go:43: Logging into bookinfo as "jason" === RUN TestRequestRouting/not-logged-in request_routing_test.go:48: request_routing_test.go:48: STEP 1: get productpage without logging in; expect to get reviews-v1 (5x) request_routing_test.go:49: SUCCESS: productpage called reviews-v1 request_routing_test.go:49: SUCCESS: productpage called reviews-v1 request_routing_test.go:49: SUCCESS: productpage called reviews-v1 request_routing_test.go:49: SUCCESS: productpage called reviews-v1 request_routing_test.go:49: SUCCESS: productpage called reviews-v1 subtest.go:23: subtest.go:28: Subtest completed in 4.06s (excluding cleanup) --- PASS: TestRequestRouting/not-logged-in (4.06s) === RUN TestRequestRouting/logged-in request_routing_test.go:65: request_routing_test.go:65: STEP 1: get productpage as logged-in user; expect to get reviews-v2 (5x) request_routing_test.go:66: SUCCESS: productpage called reviews-v2 request_routing_test.go:66: SUCCESS: productpage called reviews-v2 request_routing_test.go:66: SUCCESS: productpage called reviews-v2 request_routing_test.go:66: SUCCESS: productpage called reviews-v2 request_routing_test.go:66: SUCCESS: productpage called reviews-v2 subtest.go:23: subtest.go:28: Subtest completed in 3.34s (excluding cleanup) --- PASS: TestRequestRouting/logged-in (3.34s) test.go:77: test.go:82: Test completed in 35.25s (excluding cleanup) request_routing_test.go:33: request_routing_test.go:33: Performing cleanup request_routing_test.go:34: Deleting namespaces: [bookinfo] request_routing_test.go:34: Creating namespaces: [bookinfo] request_routing_test.go:33: Cleanup completed in 15.85s --- PASS: TestRequestRouting (51.10s) === RUN TestRequestTimeouts request_timeouts_test.go:42: request_timeouts_test.go:42: STEP 1: Apply default SMCP and SMMR manifests request_timeouts_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... request_timeouts_test.go:42: SUCCESS: Condition condition=Ready met by smcp istio-system/basic request_timeouts_test.go:44: request_timeouts_test.go:44: STEP 2: Install Bookinfo request_timeouts_test.go:45: Install app "bookinfo" in namespace "bookinfo" request_timeouts_test.go:45: Create Bookinfo Gateway request_timeouts_test.go:45: Create Bookinfo Destination Rules (all) request_timeouts_test.go:45: Create Bookinfo Deployments request_timeouts_test.go:45: Wait for app bookinfo/bookinfo to be ready request_timeouts_test.go:51: request_timeouts_test.go:51: STEP 3: make sure there is no timeout before applying delay and timeout in VirtualServices request_timeouts_test.go:52: SUCCESS: received normal productpage response request_timeouts_test.go:62: request_timeouts_test.go:62: STEP 4: apply delay and timeout in VirtualServices request_timeouts_test.go:65: request_timeouts_test.go:65: STEP 5: check if productpage shows 'error fetching product reviews' due to delay and timeout injection request_timeouts_test.go:66: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:66: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:66: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:66: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:66: SUCCESS: productpage shows 'error fetching product reviews', which is expected request_timeouts_test.go:66: SUCCESS: productpage shows 'error fetching product reviews', which is expected test.go:77: test.go:82: Test completed in 40.22s (excluding cleanup) request_timeouts_test.go:38: request_timeouts_test.go:38: Performing cleanup request_timeouts_test.go:39: Deleting namespaces: [bookinfo] request_timeouts_test.go:39: Creating namespaces: [bookinfo] request_timeouts_test.go:38: Cleanup completed in 16.54s --- PASS: TestRequestTimeouts (56.76s) === RUN TestMirroring traffic_mirroring_test.go:38: traffic_mirroring_test.go:38: STEP 1: Apply default SMCP and SMMR manifests traffic_mirroring_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... traffic_mirroring_test.go:38: SUCCESS: Condition condition=Ready met by smcp istio-system/basic traffic_mirroring_test.go:40: traffic_mirroring_test.go:40: STEP 2: Install httpbin-v1, httpbin-v2, and sleep traffic_mirroring_test.go:41: Install app "httpbin-v1" in namespace "bookinfo" traffic_mirroring_test.go:41: Install app "httpbin-v2" in namespace "bookinfo" traffic_mirroring_test.go:41: Install app "sleep" in namespace "bookinfo" traffic_mirroring_test.go:41: Wait for app bookinfo/httpbin-v1 to be ready traffic_mirroring_test.go:41: Wait for app bookinfo/httpbin-v2 to be ready traffic_mirroring_test.go:41: Wait for app bookinfo/sleep to be ready === RUN TestMirroring/no_mirroring traffic_mirroring_test.go:49: traffic_mirroring_test.go:49: STEP 1: sending HTTP request from sleep to httpbin-v1, not expecting mirroring to v2 traffic_mirroring_test.go:50: SUCCESS: request received by httpbin-v1 traffic_mirroring_test.go:50: SUCCESS: request not mirrored to httpbin-v2 subtest.go:23: subtest.go:28: Subtest completed in 3.73s (excluding cleanup) --- PASS: TestMirroring/no_mirroring (3.73s) === RUN TestMirroring/mirroring_to_httpbin-v2 traffic_mirroring_test.go:79: traffic_mirroring_test.go:79: STEP 1: sending HTTP request from sleep to httpbin-v1, expecting mirroring to v2 traffic_mirroring_test.go:80: SUCCESS: request received by httpbin-v1 traffic_mirroring_test.go:80: SUCCESS: request mirrored to httpbin-v2 subtest.go:23: subtest.go:28: Subtest completed in 3.72s (excluding cleanup) --- PASS: TestMirroring/mirroring_to_httpbin-v2 (3.72s) test.go:77: test.go:82: Test completed in 29.73s (excluding cleanup) traffic_mirroring_test.go:34: traffic_mirroring_test.go:34: Performing cleanup traffic_mirroring_test.go:35: Deleting namespaces: [bookinfo] traffic_mirroring_test.go:35: Creating namespaces: [bookinfo] traffic_mirroring_test.go:34: Cleanup completed in 15.91s --- PASS: TestMirroring (45.64s) === RUN TestTrafficShifting traffic_shifting_test.go:41: traffic_shifting_test.go:41: STEP 1: Apply default SMCP and SMMR manifests traffic_shifting_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... traffic_shifting_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic traffic_shifting_test.go:43: traffic_shifting_test.go:43: STEP 2: Install Bookinfo traffic_shifting_test.go:44: Install app "bookinfo" in namespace "bookinfo" traffic_shifting_test.go:44: Create Bookinfo Gateway traffic_shifting_test.go:44: Create Bookinfo Destination Rules (all) traffic_shifting_test.go:44: Create Bookinfo Deployments traffic_shifting_test.go:44: Wait for app bookinfo/bookinfo to be ready === RUN TestTrafficShifting/50_percent_to_v3 traffic_shifting_test.go:50: traffic_shifting_test.go:50: STEP 1: configure VirtualService to split traffic 50% to v1 and 50% to v3 traffic_shifting_test.go:53: traffic_shifting_test.go:53: STEP 2: Make 100 requests and check if v1 and v3 get 50% of requests each (tolerance: 20%) traffic_shifting_test.go:116: SUCCESS: 47/100 responses matched productpage-normal-user-v3.html (actual rate 0.470000, expected 0.500000, tolerance 0.200000) traffic_shifting_test.go:116: SUCCESS: 53/100 responses matched productpage-normal-user-v1.html (actual rate 0.530000, expected 0.500000, tolerance 0.200000) traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 traffic_shifting_test.go:54: SUCCESS: received expected status code 200 subtest.go:23: subtest.go:28: Subtest completed in 12.32s (excluding cleanup) --- PASS: TestTrafficShifting/50_percent_to_v3 (12.32s) === RUN TestTrafficShifting/100_percent_to_v3 traffic_shifting_test.go:64: traffic_shifting_test.go:64: STEP 1: configure VirtualService to send all traffic to v3 traffic_shifting_test.go:67: traffic_shifting_test.go:67: STEP 2: Make 100 requests and check if all of them go to v3 (tolerance: 0%) traffic_shifting_test.go:116: SUCCESS: 100/100 responses matched productpage-normal-user-v3.html (actual rate 1.000000, expected 1.000000, tolerance 0.000000) traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 traffic_shifting_test.go:68: SUCCESS: received expected status code 200 subtest.go:23: subtest.go:28: Subtest completed in 17.65s (excluding cleanup) --- PASS: TestTrafficShifting/100_percent_to_v3 (17.65s) test.go:77: test.go:82: Test completed in 56.76s (excluding cleanup) traffic_shifting_test.go:37: traffic_shifting_test.go:37: Performing cleanup traffic_shifting_test.go:38: Deleting namespaces: [bookinfo] traffic_shifting_test.go:38: Creating namespaces: [bookinfo] traffic_shifting_test.go:37: Cleanup completed in 16.61s --- PASS: TestTrafficShifting (73.37s) === RUN TestTcpTrafficShifting traffic_tcp_shifting_test.go:41: This test validates traffic shifting for TCP traffic. traffic_tcp_shifting_test.go:42: Doc reference: https://istio.io/v1.14/docs/tasks/traffic-management/tcp-traffic-shifting/ traffic_tcp_shifting_test.go:44: traffic_tcp_shifting_test.go:44: STEP 1: Apply default SMCP and SMMR manifests traffic_tcp_shifting_test.go:44: Wait for condition condition=Ready on smcp istio-system/basic... traffic_tcp_shifting_test.go:44: SUCCESS: Condition condition=Ready met by smcp istio-system/basic traffic_tcp_shifting_test.go:46: traffic_tcp_shifting_test.go:46: STEP 2: Install sleep, echoV1 and echoV2 traffic_tcp_shifting_test.go:47: Install app "sleep" in namespace "foo" traffic_tcp_shifting_test.go:47: Install app "echo-v1" in namespace "foo" traffic_tcp_shifting_test.go:47: Install app "echo-v2" in namespace "foo" traffic_tcp_shifting_test.go:47: Wait for app foo/sleep to be ready traffic_tcp_shifting_test.go:47: Wait for app foo/echo-v1 to be ready traffic_tcp_shifting_test.go:47: Wait for app foo/echo-v2 to be ready === RUN TestTcpTrafficShifting/tcp_shift_100_percent_to_v1 traffic_tcp_shifting_test.go:54: traffic_tcp_shifting_test.go:54: STEP 1: Shifting all TCP traffic to v1 traffic_tcp_shifting_test.go:57: traffic_tcp_shifting_test.go:57: STEP 2: make 20 requests and checking if all of them go to v1 (tolerance: 0%) traffic_tcp_shifting_test.go:114: SUCCESS: 20/20 responses matched one (actual rate 1.000000, expected 1.000000, tolerance 0.000000) subtest.go:23: subtest.go:28: Subtest completed in 2.37s (excluding cleanup) traffic_tcp_shifting_test.go:50: traffic_tcp_shifting_test.go:50: Performing cleanup traffic_tcp_shifting_test.go:50: Cleanup completed in 0.23s --- PASS: TestTcpTrafficShifting/tcp_shift_100_percent_to_v1 (2.60s) === RUN TestTcpTrafficShifting/tcp_shift_20_percent_to_v2 traffic_tcp_shifting_test.go:72: traffic_tcp_shifting_test.go:72: STEP 1: Shifting 20 percent TCP traffic to v2 traffic_tcp_shifting_test.go:75: traffic_tcp_shifting_test.go:75: STEP 2: make 100 requests and checking if 20 percent of them go to v2 (tolerance: 10%) traffic_tcp_shifting_test.go:114: SUCCESS: 81/100 responses matched one (actual rate 0.810000, expected 0.800000, tolerance 0.100000) traffic_tcp_shifting_test.go:114: SUCCESS: 19/100 responses matched two (actual rate 0.190000, expected 0.200000, tolerance 0.100000) subtest.go:23: subtest.go:28: Subtest completed in 2.68s (excluding cleanup) traffic_tcp_shifting_test.go:68: traffic_tcp_shifting_test.go:68: Performing cleanup traffic_tcp_shifting_test.go:68: Cleanup completed in 0.22s --- PASS: TestTcpTrafficShifting/tcp_shift_20_percent_to_v2 (2.90s) test.go:77: test.go:82: Test completed in 26.11s (excluding cleanup) traffic_tcp_shifting_test.go:37: traffic_tcp_shifting_test.go:37: Performing cleanup traffic_tcp_shifting_test.go:37: Cleanup completed in 1.39s --- PASS: TestTcpTrafficShifting (27.50s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/traffic 377.302s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAccessExternalServices access_external_services_test.go:43: This test validates accesses to external services access_external_services_test.go:45: access_external_services_test.go:45: STEP 1: Apply default SMCP and SMMR manifests access_external_services_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... access_external_services_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic access_external_services_test.go:47: access_external_services_test.go:47: STEP 2: Install sleep into bookinfo access_external_services_test.go:49: Install app "sleep" in namespace "bookinfo" access_external_services_test.go:49: Wait for app bookinfo/sleep to be ready access_external_services_test.go:51: access_external_services_test.go:51: STEP 3: Install httpbin in mesh-external access_external_services_test.go:53: Install app "httpbin" in namespace "mesh-external" access_external_services_test.go:53: Wait for app mesh-external/httpbin to be ready access_external_services_test.go:55: access_external_services_test.go:55: STEP 4: Make request to external httpbin from sleep egress_common.go:24: SUCCESS: Got expected 200 OK from http://httpbin.mesh-external:8000/headers access_external_services_test.go:59: access_external_services_test.go:59: STEP 5: Make sure that external httpbin was not discovered by Istio istioctl.go:11: SUCCESS: Httpbin was not discovered access_external_services_test.go:67: access_external_services_test.go:67: STEP 6: Patch outbound traffic policy to registry only - see https://istio.io/latest/docs/tasks/traffic-management/egress/egress-control/#envoy-passthrough-to-external-services access_external_services_test.go:81: access_external_services_test.go:81: STEP 7: Make request to external httpbin from sleep again, and expect it denied egress_common.go:31: SUCCESS: Got a failure message as expected === RUN TestAccessExternalServices/allow_request_to_external_httpbin_after_applying_ServiceEntry access_external_services_test.go:89: access_external_services_test.go:89: STEP 1: Apply a ServiceEntry for external httpbin access_external_services_test.go:92: access_external_services_test.go:92: STEP 2: Send a request to external httpbin egress_common.go:24: SUCCESS: Got expected 200 OK from http://httpbin.mesh-external:8000/headers subtest.go:23: subtest.go:28: Subtest completed in 2.86s (excluding cleanup) access_external_services_test.go:85: access_external_services_test.go:85: Performing cleanup access_external_services_test.go:85: Cleanup completed in 0.25s --- PASS: TestAccessExternalServices/allow_request_to_external_httpbin_after_applying_ServiceEntry (3.11s) test.go:77: test.go:82: Test completed in 32.04s (excluding cleanup) access_external_services_test.go:35: access_external_services_test.go:35: Performing cleanup access_external_services_test.go:35: Cleanup completed in 0.97s --- PASS: TestAccessExternalServices (33.01s) === RUN TestEgressGateways egress_gateways_test.go:33: egress_gateways_test.go:33: STEP 1: Apply default SMCP and SMMR manifests egress_gateways_test.go:33: Wait for condition condition=Ready on smcp istio-system/basic... egress_gateways_test.go:33: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_gateways_test.go:35: egress_gateways_test.go:35: STEP 2: Install sleep pod egress_gateways_test.go:37: Install app "sleep" in namespace "bookinfo" egress_gateways_test.go:37: Wait for app bookinfo/sleep to be ready === RUN TestEgressGateways/HTTP egress_gateways_test.go:40: egress_gateways_test.go:40: STEP 1: Install external httpbin egress_gateways_test.go:42: Install app "httpbin" in namespace "mesh-external" egress_gateways_test.go:42: Wait for app mesh-external/httpbin to be ready egress_gateways_test.go:44: egress_gateways_test.go:44: STEP 2: Apply a ServiceEntry for external httpbin egress_gateways_test.go:50: egress_gateways_test.go:50: STEP 3: Apply a gateway and virtual service for external httpbin egress_common.go:24: SUCCESS: Got expected 200 OK from http://httpbin.mesh-external:8000/headers subtest.go:23: subtest.go:28: Subtest completed in 4.85s (excluding cleanup) egress_gateways_test.go:52: egress_gateways_test.go:52: Performing cleanup egress_gateways_test.go:52: Cleanup completed in 0.28s egress_gateways_test.go:46: egress_gateways_test.go:46: Performing cleanup egress_gateways_test.go:46: Cleanup completed in 0.33s --- PASS: TestEgressGateways/HTTP (5.45s) === RUN TestEgressGateways/HTTPS egress_gateways_test.go:60: egress_gateways_test.go:60: STEP 1: Install external nginx egress_gateways_test.go:61: Install app "nginx" in namespace "mesh-external" egress_gateways_test.go:61: Wait for app mesh-external/nginx to be ready egress_gateways_test.go:63: egress_gateways_test.go:63: STEP 2: Create ServiceEntry for external nginx, port 80 and 443 egress_gateways_test.go:69: egress_gateways_test.go:69: STEP 3: Create a TLS ServiceEntry to external nginx egress_gateways_test.go:75: egress_gateways_test.go:75: STEP 4: Create a https Gateway to external nginx egress_gateways_test.go:81: Send HTTPS request to external nginx egress_common.go:39: SUCCESS: Got expected 200 OK from curl -sSL --insecure -o /dev/null -w "%{http_code}" https://my-nginx.mesh-external.svc.cluster.local 2>/dev/null || echo CURL_FAILED subtest.go:23: subtest.go:28: Subtest completed in 12.15s (excluding cleanup) egress_gateways_test.go:77: egress_gateways_test.go:77: Performing cleanup egress_gateways_test.go:77: Cleanup completed in 0.28s egress_gateways_test.go:71: egress_gateways_test.go:71: Performing cleanup egress_gateways_test.go:71: Cleanup completed in 0.27s egress_gateways_test.go:65: egress_gateways_test.go:65: Performing cleanup egress_gateways_test.go:65: Cleanup completed in 0.20s --- PASS: TestEgressGateways/HTTPS (12.90s) test.go:77: test.go:82: Test completed in 36.02s (excluding cleanup) egress_gateways_test.go:29: egress_gateways_test.go:29: Performing cleanup egress_gateways_test.go:30: Deleting namespaces: [bookinfo] egress_gateways_test.go:30: Creating namespaces: [bookinfo] egress_gateways_test.go:29: Cleanup completed in 14.97s --- PASS: TestEgressGateways (50.99s) === RUN TestTLSOrigination egress_gateways_tls_file_mount_test.go:33: This test verifies that TLS origination works in 2 scenarios: egress_gateways_tls_file_mount_test.go:34: 1) Egress gateway TLS Origination egress_gateways_tls_file_mount_test.go:35: 2) MTLS Origination with file mount (certificates mounted in egress gateway pod) egress_gateways_tls_file_mount_test.go:41: egress_gateways_tls_file_mount_test.go:41: STEP 1: Apply default SMCP and SMMR manifests egress_gateways_tls_file_mount_test.go:41: Wait for condition condition=Ready on smcp istio-system/basic... egress_gateways_tls_file_mount_test.go:41: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_gateways_tls_file_mount_test.go:43: egress_gateways_tls_file_mount_test.go:43: STEP 2: Install sleep pod egress_gateways_tls_file_mount_test.go:44: Install app "sleep" in namespace "bookinfo" egress_gateways_tls_file_mount_test.go:44: Wait for app bookinfo/sleep to be ready === RUN TestTLSOrigination/Egress_Gateway_without_file_mount egress_gateways_tls_file_mount_test.go:47: Perform TLS origination with an egress gateway egress_gateways_tls_file_mount_test.go:49: egress_gateways_tls_file_mount_test.go:49: STEP 1: Install external nginx egress_gateways_tls_file_mount_test.go:50: Install app "nginx" in namespace "mesh-external" egress_gateways_tls_file_mount_test.go:50: Wait for app mesh-external/nginx to be ready egress_gateways_tls_file_mount_test.go:52: egress_gateways_tls_file_mount_test.go:52: STEP 2: Make sure that mesh external namespace is not discovered by Istio - it would happen if mesh-external namespaces was added to the SMMR istioctl.go:11: SUCCESS: mesh-external namespace was not discovered egress_gateways_tls_file_mount_test.go:60: egress_gateways_tls_file_mount_test.go:60: STEP 3: Create ServiceEntry for external nginx, port 80 and 443 egress_gateways_tls_file_mount_test.go:66: egress_gateways_tls_file_mount_test.go:66: STEP 4: Create a Gateway, DestinationRule, and VirtualService to route requests to external nginx through the egress gateway egress_gateways_tls_file_mount_test.go:74: egress_gateways_tls_file_mount_test.go:74: STEP 5: Verify that request to external nginx is routed through the egress gateway (response 200 indicates that the TLS origination is done by the egress gateway) egress_gateways_tls_file_mount_test.go:75: SUCCESS: Get expected response: Welcome to nginx subtest.go:23: subtest.go:28: Subtest completed in 9.10s (excluding cleanup) egress_gateways_tls_file_mount_test.go:69: egress_gateways_tls_file_mount_test.go:69: Performing cleanup egress_gateways_tls_file_mount_test.go:69: Cleanup completed in 0.47s egress_gateways_tls_file_mount_test.go:62: egress_gateways_tls_file_mount_test.go:62: Performing cleanup egress_gateways_tls_file_mount_test.go:62: Cleanup completed in 0.30s --- PASS: TestTLSOrigination/Egress_Gateway_without_file_mount (9.87s) === RUN TestTLSOrigination/mTLS_with_file_mount egress_gateways_tls_file_mount_test.go:84: Perform mTLS origination with an egress gateway egress_gateways_tls_file_mount_test.go:98: egress_gateways_tls_file_mount_test.go:98: STEP 1: Deploy nginx mTLS server and create secrets in the mesh namespace egress_gateways_tls_file_mount_test.go:103: Install app "nginx" in namespace "mesh-external" egress_gateways_tls_file_mount_test.go:105: egress_gateways_tls_file_mount_test.go:105: STEP 2: Patch egress gateway with File Mount configuration egress_gateways_tls_file_mount_test.go:108: egress_gateways_tls_file_mount_test.go:108: STEP 3: Configure mTLS origination for egress traffic egress_gateways_tls_file_mount_test.go:112: egress_gateways_tls_file_mount_test.go:112: STEP 4: Wait for egress gateway and nginx to be ready egress_gateways_tls_file_mount_test.go:114: Wait for app mesh-external/nginx to be ready egress_gateways_tls_file_mount_test.go:116: egress_gateways_tls_file_mount_test.go:116: STEP 5: Verify NGINX server egress_gateways_tls_file_mount_test.go:117: SUCCESS: Get expected response: Welcome to nginx subtest.go:23: subtest.go:28: Subtest completed in 10.76s (excluding cleanup) egress_gateways_tls_file_mount_test.go:85: egress_gateways_tls_file_mount_test.go:85: Performing cleanup egress_gateways_tls_file_mount_test.go:95: SUCCESS: Pod istio-ingressgateway-7759879bf9-cdqsk is being deleted egress_gateways_tls_file_mount_test.go:85: Cleanup completed in 10.48s --- PASS: TestTLSOrigination/mTLS_with_file_mount (21.23s) test.go:77: test.go:82: Test completed in 48.96s (excluding cleanup) egress_gateways_tls_file_mount_test.go:37: egress_gateways_tls_file_mount_test.go:37: Performing cleanup egress_gateways_tls_file_mount_test.go:37: Cleanup completed in 0.67s --- PASS: TestTLSOrigination (49.63s) === RUN TestTLSOriginationSDS egress_gateways_tls_sds_test.go:37: Perform mTLS origination with an egress gateway egress_gateways_tls_sds_test.go:38: egress_gateways_tls_sds_test.go:38: STEP 1: Apply default SMCP and SMMR manifests egress_gateways_tls_sds_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... egress_gateways_tls_sds_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... egress_gateways_tls_sds_test.go:38: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_gateways_tls_sds_test.go:40: egress_gateways_tls_sds_test.go:40: STEP 2: Install sleep pod egress_gateways_tls_sds_test.go:42: Install app "sleep" in namespace "bookinfo" egress_gateways_tls_sds_test.go:42: Wait for app bookinfo/sleep to be ready egress_gateways_tls_sds_test.go:44: egress_gateways_tls_sds_test.go:44: STEP 3: Deploy nginx mTLS server and create secrets in the mesh namespace egress_gateways_tls_sds_test.go:45: Install app "nginx" in namespace "mesh-external" egress_gateways_tls_sds_test.go:45: Wait for app mesh-external/nginx to be ready egress_gateways_tls_sds_test.go:53: Send HTTP request to external nginx to verify mTLS origination egress_common.go:24: SUCCESS: Got expected 200 OK from http://my-nginx.mesh-external.svc.cluster.local test.go:77: test.go:82: Test completed in 31.68s (excluding cleanup) egress_gateways_tls_sds_test.go:29: egress_gateways_tls_sds_test.go:29: Performing cleanup egress_gateways_tls_sds_test.go:30: Deleting namespaces: [bookinfo] egress_gateways_tls_sds_test.go:30: Creating namespaces: [bookinfo] egress_gateways_tls_sds_test.go:31: Deleting namespaces: [mesh-external] egress_gateways_tls_sds_test.go:31: Creating namespaces: [mesh-external] egress_gateways_tls_sds_test.go:29: Cleanup completed in 31.00s --- PASS: TestTLSOriginationSDS (62.67s) === RUN TestEgressTLSOrigination egress_tls_origination_test.go:35: egress_tls_origination_test.go:35: STEP 1: Apply default SMCP and SMMR manifests egress_tls_origination_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... egress_tls_origination_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_tls_origination_test.go:37: egress_tls_origination_test.go:37: STEP 2: Install sleep pod egress_tls_origination_test.go:38: Install app "sleep" in namespace "bookinfo" egress_tls_origination_test.go:38: Wait for app bookinfo/sleep to be ready === RUN TestEgressTLSOrigination/TrafficManagement_egress_tls_origination egress_tls_origination_test.go:41: TLS origination for egress traffic egress_tls_origination_test.go:49: Install app "nginx" in namespace "mesh-external" egress_tls_origination_test.go:49: Wait for app mesh-external/nginx to be ready egress_common.go:24: SUCCESS: Got expected 200 OK from http://my-nginx.mesh-external.svc.cluster.local subtest.go:23: subtest.go:28: Subtest completed in 13.35s (excluding cleanup) egress_tls_origination_test.go:42: egress_tls_origination_test.go:42: Performing cleanup egress_tls_origination_test.go:42: Cleanup completed in 2.37s --- PASS: TestEgressTLSOrigination/TrafficManagement_egress_tls_origination (15.72s) test.go:77: test.go:82: Test completed in 33.60s (excluding cleanup) egress_tls_origination_test.go:30: egress_tls_origination_test.go:30: Performing cleanup egress_tls_origination_test.go:31: Deleting namespaces: [mesh-external] egress_tls_origination_test.go:31: Creating namespaces: [mesh-external] egress_tls_origination_test.go:30: Cleanup completed in 9.33s --- PASS: TestEgressTLSOrigination (42.93s) === RUN TestEgressWildcard egress_wildcard_hosts_test.go:31: This test checks if the wildcard in the ServiceEntry and Gateway works as expected for Egress traffic. egress_wildcard_hosts_test.go:35: egress_wildcard_hosts_test.go:35: STEP 1: Apply default SMCP and SMMR manifests egress_wildcard_hosts_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... egress_wildcard_hosts_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic egress_wildcard_hosts_test.go:37: egress_wildcard_hosts_test.go:37: STEP 2: Install the sleep pod egress_wildcard_hosts_test.go:38: Install app "sleep" in namespace "bookinfo" egress_wildcard_hosts_test.go:38: Wait for app bookinfo/sleep to be ready === RUN TestEgressWildcard/ServiceEntry egress_wildcard_hosts_test.go:44: egress_wildcard_hosts_test.go:44: STEP 1: Configure ServiceEntry with wildcard host *.wikipedia.org egress_wildcard_hosts_test.go:66: egress_wildcard_hosts_test.go:66: STEP 2: Check external request to en.wikipedia.org and de.wikipedia.org egress_wildcard_hosts_test.go:67: SUCCESS: Received the correct response from en.wikipedia.org egress_wildcard_hosts_test.go:67: SUCCESS: Received the correct response from de.wikipedia.org subtest.go:23: subtest.go:28: Subtest completed in 3.94s (excluding cleanup) egress_wildcard_hosts_test.go:46: egress_wildcard_hosts_test.go:46: Performing cleanup egress_wildcard_hosts_test.go:46: Cleanup completed in 0.21s --- PASS: TestEgressWildcard/ServiceEntry (4.14s) === RUN TestEgressWildcard/Gateway egress_wildcard_hosts_test.go:54: egress_wildcard_hosts_test.go:54: STEP 1: Configure egress Gateway with wildcard host *.wikipedia.org egress_wildcard_hosts_test.go:66: egress_wildcard_hosts_test.go:66: STEP 2: Check external request to en.wikipedia.org and de.wikipedia.org egress_wildcard_hosts_test.go:67: SUCCESS: Received the correct response from en.wikipedia.org egress_wildcard_hosts_test.go:67: SUCCESS: Received the correct response from de.wikipedia.org subtest.go:23: subtest.go:28: Subtest completed in 3.21s (excluding cleanup) egress_wildcard_hosts_test.go:56: egress_wildcard_hosts_test.go:56: Performing cleanup egress_wildcard_hosts_test.go:56: Cleanup completed in 0.26s --- PASS: TestEgressWildcard/Gateway (3.47s) test.go:77: test.go:82: Test completed in 25.77s (excluding cleanup) egress_wildcard_hosts_test.go:39: egress_wildcard_hosts_test.go:39: Performing cleanup egress_wildcard_hosts_test.go:39: Cleanup completed in 0.62s --- PASS: TestEgressWildcard (26.39s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/traffic/egress 267.123s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestGatewayApi gatewayapi_test.go:28: gatewayapi_test.go:28: STEP 1: Apply default SMCP and SMMR manifests gatewayapi_test.go:28: Wait for condition condition=Ready on smcp istio-system/basic... gatewayapi_test.go:28: SUCCESS: Condition condition=Ready met by smcp istio-system/basic gatewayapi_test.go:30: gatewayapi_test.go:30: STEP 2: Install Gateway API CRD's gatewayapi_test.go:33: Creating namespaces: [foo] === RUN TestGatewayApi/Deploy_the_Kubernetes_Gateway_API gatewayapi_test.go:42: gatewayapi_test.go:42: STEP 1: Install httpbin gatewayapi_test.go:43: Install app "httpbin" in namespace "foo" gatewayapi_test.go:43: Wait for app foo/httpbin to be ready gatewayapi_test.go:45: gatewayapi_test.go:45: STEP 2: Deploy the Gateway SMCP gatewayapi_test.go:78: gatewayapi_test.go:78: STEP 3: Deploy the Gateway API configuration including a single exposed route (i.e., /get) gatewayapi_test.go:84: gatewayapi_test.go:84: STEP 4: Wait for Gateway to be ready gatewayapi_test.go:85: Wait for condition condition=Ready on Gateway foo/gateway... gatewayapi_test.go:85: SUCCESS: Condition condition=Ready met by Gateway foo/gateway gatewayapi_test.go:87: gatewayapi_test.go:87: STEP 5: Verfiy the GatewayApi access the httpbin service using curl gatewayapi_test.go:88: SUCCESS: Access the httpbin service with GatewayApi subtest.go:23: subtest.go:28: Subtest completed in 18.77s (excluding cleanup) gatewayapi_test.go:80: gatewayapi_test.go:80: Performing cleanup gatewayapi_test.go:80: Cleanup completed in 0.19s gatewayapi_test.go:59: gatewayapi_test.go:59: Performing cleanup gatewayapi_test.go:59: Cleanup completed in 0.33s gatewayapi_test.go:37: gatewayapi_test.go:37: Performing cleanup gatewayapi_test.go:38: Deleting namespaces: [istio-system] gatewayapi_test.go:38: Creating namespaces: [istio-system] gatewayapi_test.go:39: Deleting namespaces: [foo] gatewayapi_test.go:39: Creating namespaces: [foo] gatewayapi_test.go:37: Cleanup completed in 103.31s --- PASS: TestGatewayApi/Deploy_the_Kubernetes_Gateway_API (122.60s) === RUN TestGatewayApi/Deploy_the_Gateway-Controller_Profile gatewayapi_test.go:101: Gateway-Controller Profile was added in v2.4 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) --- SKIP: TestGatewayApi/Deploy_the_Gateway-Controller_Profile (0.00s) test.go:77: test.go:82: Test completed in 136.60s (excluding cleanup) --- PASS: TestGatewayApi (136.60s) === RUN TestIngressGateways ingress_gateways_test.go:42: ingress_gateways_test.go:42: STEP 1: Apply default SMCP and SMMR manifests ingress_gateways_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... ingress_gateways_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... ingress_gateways_test.go:42: Wait for condition condition=Ready on smcp istio-system/basic... ingress_gateways_test.go:42: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ingress_gateways_test.go:44: ingress_gateways_test.go:44: STEP 2: Install httpbin ingress_gateways_test.go:45: Install app "httpbin" in namespace "bookinfo" ingress_gateways_test.go:45: Wait for app bookinfo/httpbin to be ready === RUN TestIngressGateways/TrafficManagement_ingress_status_200_test ingress_gateways_test.go:50: ingress_gateways_test.go:50: STEP 1: Create httpbin Gateway and VirtualService with host set to httpbin.example.com ingress_gateways_test.go:57: ingress_gateways_test.go:57: STEP 2: Check if httpbin service is reachable through istio-ingressgateway ingress_gateways_test.go:58: SUCCESS: received expected status code 200 subtest.go:23: subtest.go:28: Subtest completed in 2.37s (excluding cleanup) --- PASS: TestIngressGateways/TrafficManagement_ingress_status_200_test (2.37s) === RUN TestIngressGateways/TrafficManagement_ingress_headers_test ingress_gateways_test.go:67: ingress_gateways_test.go:67: STEP 1: Create httpbin Gateway and VirtualService with host set to * ingress_gateways_test.go:70: ingress_gateways_test.go:70: STEP 2: Check if httpbin service is reachable through istio-ingressgateway ingress_gateways_test.go:71: SUCCESS: received expected status code 200 subtest.go:23: subtest.go:28: Subtest completed in 1.57s (excluding cleanup) --- PASS: TestIngressGateways/TrafficManagement_ingress_headers_test (1.57s) test.go:77: test.go:82: Test completed in 37.53s (excluding cleanup) ingress_gateways_test.go:38: ingress_gateways_test.go:38: Performing cleanup ingress_gateways_test.go:39: Deleting namespaces: [bookinfo] ingress_gateways_test.go:39: Creating namespaces: [bookinfo] ingress_gateways_test.go:38: Cleanup completed in 21.79s --- PASS: TestIngressGateways (59.32s) === RUN TestIngressWithoutTlsTermination ingress_without_tls_termination_test.go:36: This test validates configuring an Gateway with TLS PassThrough ingress_without_tls_termination_test.go:37: Doc reference: https://istio.io/v1.14/docs/tasks/traffic-management/ingress/ingress-sni-passthrough/ ingress_without_tls_termination_test.go:46: ingress_without_tls_termination_test.go:46: STEP 1: Apply default SMCP and SMMR manifests ingress_without_tls_termination_test.go:46: Wait for condition condition=Ready on smcp istio-system/basic... ingress_without_tls_termination_test.go:46: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ingress_without_tls_termination_test.go:48: ingress_without_tls_termination_test.go:48: STEP 2: Create NGINX Deployment ingress_without_tls_termination_test.go:49: Install app "nginx" in namespace "bookinfo" ingress_without_tls_termination_test.go:49: Wait for app bookinfo/nginx to be ready ingress_without_tls_termination_test.go:51: ingress_without_tls_termination_test.go:51: STEP 3: Verify NGINX server is running by connecting to it via loopback ingress_without_tls_termination_test.go:52: SUCCESS: Got expected Welcome to nginx response ingress_without_tls_termination_test.go:63: ingress_without_tls_termination_test.go:63: STEP 4: Configure Gateway resource with TLS passthrough for host nginx.example.com ingress_without_tls_termination_test.go:70: ingress_without_tls_termination_test.go:70: STEP 5: Verify NGINX is reachable from outside the cluster through the ingressgateway ingress_without_tls_termination_test.go:73: SUCCESS: string 'Welcome to nginx' found in response test.go:77: test.go:82: Test completed in 33.86s (excluding cleanup) ingress_without_tls_termination_test.go:41: ingress_without_tls_termination_test.go:41: Performing cleanup ingress_without_tls_termination_test.go:41: Cleanup completed in 1.71s --- PASS: TestIngressWithoutTlsTermination (35.58s) === RUN TestSecureGateways secure_gateways_test.go:59: secure_gateways_test.go:59: STEP 1: Apply default SMCP and SMMR manifests secure_gateways_test.go:59: Wait for condition condition=Ready on smcp istio-system/basic... secure_gateways_test.go:59: SUCCESS: Condition condition=Ready met by smcp istio-system/basic secure_gateways_test.go:61: secure_gateways_test.go:61: STEP 2: Install httpbin secure_gateways_test.go:62: Install app "httpbin" in namespace "bookinfo" secure_gateways_test.go:62: Wait for app bookinfo/httpbin to be ready secure_gateways_test.go:66: secure_gateways_test.go:66: STEP 3: Create TLS secrets === RUN TestSecureGateways/tls_single_host secure_gateways_test.go:76: secure_gateways_test.go:76: STEP 1: Configure a TLS ingress gateway for a single host secure_gateways_test.go:83: SUCCESS: string '-=[ teapot ]=-' found in response subtest.go:23: subtest.go:28: Subtest completed in 2.27s (excluding cleanup) --- PASS: TestSecureGateways/tls_single_host (2.27s) === RUN TestSecureGateways/tls_multiple_hosts secure_gateways_test.go:93: secure_gateways_test.go:93: STEP 1: configure Gateway with multiple TLS hosts secure_gateways_test.go:101: secure_gateways_test.go:101: STEP 2: check if helloworld-v1 responds with 200 OK secure_gateways_test.go:102: SUCCESS: received expected status code 200 secure_gateways_test.go:109: secure_gateways_test.go:109: STEP 3: check if httpbin responds with teapot secure_gateways_test.go:110: SUCCESS: string '-=[ teapot ]=-' found in response subtest.go:23: subtest.go:28: Subtest completed in 5.12s (excluding cleanup) --- PASS: TestSecureGateways/tls_multiple_hosts (5.12s) === RUN TestSecureGateways/mutual_tls secure_gateways_test.go:119: secure_gateways_test.go:119: STEP 1: configure Gateway with tls.mode=Mutual secure_gateways_test.go:130: secure_gateways_test.go:130: STEP 2: check if SSL handshake fails when no client certificate is given secure_gateways_test.go:131: failed to get HTTP Response: Get "https://httpbin.example.com:443/status/418": remote error: tls: certificate required secure_gateways_test.go:131: SUCCESS: request failed as expected secure_gateways_test.go:140: secure_gateways_test.go:140: STEP 3: check if SSL handshake succeeds when client certificate is given secure_gateways_test.go:141: SUCCESS: string '-=[ teapot ]=-' found in response subtest.go:23: subtest.go:28: Subtest completed in 2.91s (excluding cleanup) --- PASS: TestSecureGateways/mutual_tls (2.91s) test.go:77: test.go:82: Test completed in 55.69s (excluding cleanup) secure_gateways_test.go:53: secure_gateways_test.go:53: Performing cleanup secure_gateways_test.go:56: Deleting namespaces: [bookinfo] secure_gateways_test.go:56: Creating namespaces: [bookinfo] secure_gateways_test.go:53: Cleanup completed in 15.11s --- PASS: TestSecureGateways (70.80s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/traffic/ingress 303.690s DONE 125 tests, 14 skipped, 3 failures in 3582.983s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestInitContainerNotRemovedDuringInjection initcontainer_test.go:32: Checking init container not removed during sidecar injection. initcontainer_test.go:38: initcontainer_test.go:38: STEP 1: Apply default SMCP and SMMR manifests initcontainer_test.go:38: Wait for condition condition=Ready on smcp istio-system/basic... initcontainer_test.go:38: SUCCESS: Condition condition=Ready met by smcp istio-system/basic initcontainer_test.go:40: Deleting namespaces: [bookinfo] initcontainer_test.go:40: Creating namespaces: [bookinfo] initcontainer_test.go:42: initcontainer_test.go:42: STEP 2: Deploying test pod. initcontainer_test.go:46: initcontainer_test.go:46: STEP 3: Checking pod logs for init message. initcontainer_test.go:47: SUCCESS: Init container executed successfully. test.go:77: test.go:82: Test completed in 33.60s (excluding cleanup) initcontainer_test.go:34: initcontainer_test.go:34: Performing cleanup initcontainer_test.go:35: Deleting namespaces: [bookinfo] initcontainer_test.go:35: Creating namespaces: [bookinfo] initcontainer_test.go:34: Cleanup completed in 14.21s --- PASS: TestInitContainerNotRemovedDuringInjection (47.80s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm 49.886s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestIOR ior_test.go:41: This test verifies the behavior of IOR. ior_test.go:73: ior_test.go:73: STEP 1: Apply default SMCP and SMMR manifests ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestIOR/check_IOR_off_by_default_v2.5 ior_test.go:77: Skipping until 2.5 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) --- SKIP: TestIOR/check_IOR_off_by_default_v2.5 (0.00s) === RUN TestIOR/check_IOR_basic_functionalities ior_test.go:98: ior_test.go:98: STEP 1: Ensure the IOR enabled ior_test.go:103: ior_test.go:103: STEP 2: Check whether the IOR creates Routes for hosts specified in the Gateway ior_test.go:53: Creating Gateway for www.test.ocp host ior_test.go:58: Checking whether a Route is generated for www.test.ocp ior_test.go:68: SUCCESS: Got an expected Route for www.test.ocp subtest.go:23: subtest.go:28: Subtest completed in 1.62s (excluding cleanup) ior_test.go:92: ior_test.go:92: Performing cleanup ior_test.go:92: Cleanup completed in 0.00s --- PASS: TestIOR/check_IOR_basic_functionalities (1.62s) === RUN TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade ior_test.go:110: This test only applies for v2.3 to v2.4 upgrade subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) --- SKIP: TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade (0.00s) === RUN TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:161: ior_test.go:161: STEP 1: Ensure the IOR enabled ior_test.go:166: ior_test.go:166: STEP 2: Create 3 Gateways and they are in their own Namespace ior_test.go:176: Creating namespaces: [ns-0 ns-1 ns-2] ior_test.go:179: ior_test.go:179: STEP 3: Update SMMR to include 3 Namespaces ior_test.go:186: FATAL: Expect to find 3 Routes but found 4 instead subtest.go:23: subtest.go:25: Subtest failed in 81.10s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714122700-TestIOR-check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:151: ior_test.go:151: Performing cleanup ior_test.go:156: Deleting namespaces: [ns-0 ns-1 ns-2] ior_test.go:151: Cleanup completed in 16.28s --- FAIL: TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod (224.92s) test.go:77: test.go:79: Test failed in 238.39s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714122924-TestIOR ior_test.go:46: ior_test.go:46: Performing cleanup ior_test.go:47: Deleting namespaces: [istio-system] ior_test.go:47: Creating namespaces: [istio-system] ior_test.go:46: Cleanup completed in 23.38s --- FAIL: TestIOR (358.37s) FAIL FAIL github.com/maistra/maistra-test-tool/pkg/tests/ossm 359.798s DONE 2 runs, 131 tests, 16 skipped, 5 failures in 4001.779s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestIOR ior_test.go:41: This test verifies the behavior of IOR. ior_test.go:73: ior_test.go:73: STEP 1: Apply default SMCP and SMMR manifests ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestIOR/check_IOR_off_by_default_v2.5 ior_test.go:77: Skipping until 2.5 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) --- SKIP: TestIOR/check_IOR_off_by_default_v2.5 (0.00s) === RUN TestIOR/check_IOR_basic_functionalities ior_test.go:98: ior_test.go:98: STEP 1: Ensure the IOR enabled ior_test.go:103: ior_test.go:103: STEP 2: Check whether the IOR creates Routes for hosts specified in the Gateway ior_test.go:53: Creating Gateway for www.test.ocp host ior_test.go:58: Checking whether a Route is generated for www.test.ocp ior_test.go:68: SUCCESS: Got an expected Route for www.test.ocp subtest.go:23: subtest.go:28: Subtest completed in 1.96s (excluding cleanup) ior_test.go:92: ior_test.go:92: Performing cleanup ior_test.go:92: Cleanup completed in 0.00s --- PASS: TestIOR/check_IOR_basic_functionalities (1.97s) === RUN TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade ior_test.go:110: This test only applies for v2.3 to v2.4 upgrade subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) --- SKIP: TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade (0.00s) === RUN TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:161: ior_test.go:161: STEP 1: Ensure the IOR enabled ior_test.go:166: ior_test.go:166: STEP 2: Create 3 Gateways and they are in their own Namespace ior_test.go:176: Creating namespaces: [ns-0 ns-1 ns-2] ior_test.go:179: ior_test.go:179: STEP 3: Update SMMR to include 3 Namespaces ior_test.go:186: FATAL: Expect to find 3 Routes but found 4 instead subtest.go:23: subtest.go:25: Subtest failed in 83.22s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714123315-TestIOR-check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:151: ior_test.go:151: Performing cleanup ior_test.go:156: Deleting namespaces: [ns-0 ns-1 ns-2] ior_test.go:151: Cleanup completed in 16.79s --- FAIL: TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod (227.43s) test.go:77: test.go:79: Test failed in 250.93s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714123539-TestIOR ior_test.go:46: ior_test.go:46: Performing cleanup ior_test.go:47: Deleting namespaces: [istio-system] ior_test.go:47: Creating namespaces: [istio-system] ior_test.go:46: Cleanup completed in 19.48s --- FAIL: TestIOR (379.01s) FAIL FAIL github.com/maistra/maistra-test-tool/pkg/tests/ossm 380.700s === Skipped === SKIP: pkg/tests/ossm TestDiscoverySelectors (0.00s) discovery_selectors_test.go:34: This test checks if discoverySelectors are being honored discovery_selectors_test.go:35: See https://issues.redhat.com/browse/OSSM-3802 discovery_selectors_test.go:36: Test case is based on https://istio.io/latest/blog/2021/discovery-selectors/ discovery_selectors_test.go:38: Skipped because spec.meshConfig.discoverySelectors is only available in v2.4+ test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm TestIOR/check_IOR_off_by_default_v2.5 (0.00s) ior_test.go:77: Skipping until 2.5 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade (0.00s) ior_test.go:110: This test only applies for v2.3 to v2.4 upgrade subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm TestOperatorCanUpdatePrometheusConfigMap (0.00s) prometheus_scoped_scraping_test.go:28: This test checks if the operator can update Prometheus ConfigMap when the SMMR is updated prometheus_scoped_scraping_test.go:31: Test only valid in SMCP versions v2.4+ test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm TestRateLimiting (0.00s) test.go:120: This test is being skipped because it doesn't support the current SMCP version v2.3 (max version is v2.2) === SKIP: pkg/tests/ossm TestIOR/check_IOR_off_by_default_v2.5 (re-run 1) (0.00s) ior_test.go:77: Skipping until 2.5 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade (re-run 1) (0.00s) ior_test.go:110: This test only applies for v2.3 to v2.4 upgrade subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm TestIOR/check_IOR_off_by_default_v2.5 (re-run 2) (0.00s) ior_test.go:77: Skipping until 2.5 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm TestIOR/check_routes_aren't_deleted_during_v2.3_to_v2.4_upgrade (re-run 2) (0.00s) ior_test.go:110: This test only applies for v2.3 to v2.4 upgrade subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm-federation TestMultiClusterFederationFailover (0.00s) federation_failover_test.go:41: this test only runs when the KUBECONFIG2 environment variable points to the kubeconfig of the second cluster test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm/operator TestClusterWideMode (0.00s) test.go:117: This test is being skipped because it doesn't support the current SMCP version v2.3 (min version is v2.4) === SKIP: pkg/tests/ossm/operator TestOperatorCanReconcileSMCPWhenIstiodOffline (0.00s) operator_deadlock_test.go:16: This test checks if the operator can reconcile an SMCP even if the istiod pod is missing operator_deadlock_test.go:17: See https://issues.redhat.com/browse/OSSM-3235 operator_deadlock_test.go:20: Skipped because OSSM-3235 is only fixed in 2.4+ test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/ossm/operator TestOperatorPodHonorsReadinessProbe (0.00s) test.go:117: This test is being skipped because it doesn't support the current SMCP version v2.3 (min version is v2.4) === SKIP: pkg/tests/tasks/observability TestCustomPrometheus (0.00s) custom_prometheus_test.go:29: Extension providers are not supported in OSSM older than v2.4.0 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/tasks/observability TestOpenShiftMonitoring (0.00s) openshift_monitoring_test.go:41: integration with OpenShift Monitoring stack is not supported in OSSM older than v2.4.0 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/tasks/security/certmanager TestIstioCsr (0.00s) istio_csr_test.go:31: istio-csr is not supported in SMCP older than v2.4 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/tasks/security/certmanager TestPluginCaCert (0.00s) plugin_ca_test.go:30: istio-csr is not supported in SMCP older than v2.4 test.go:77: test.go:82: Test completed in 0.00s (excluding cleanup) === SKIP: pkg/tests/tasks/traffic/ingress TestGatewayApi/Deploy_the_Gateway-Controller_Profile (0.00s) gatewayapi_test.go:101: Gateway-Controller Profile was added in v2.4 subtest.go:23: subtest.go:28: Subtest completed in 0.00s (excluding cleanup) === Failed === FAIL: pkg/tests/ossm TestInitContainerNotRemovedDuringInjection (53.20s) initcontainer_test.go:32: Checking init container not removed during sidecar injection. initcontainer_test.go:38: initcontainer_test.go:38: STEP 1: Apply default SMCP and SMMR manifests setup.go:114: FATAL: Command failed: oc -n istio-system apply -f - Error from server (InternalError): error when creating "STDIN": Internal error occurred: failed calling webhook "smcp.mutation.maistra.io": failed to call webhook: Post "https://maistra-admission-controller.openshift-operators.svc:443/mutate-smcp?timeout=10s": no endpoints available for service "maistra-admission-controller" error: exit status 1 test.go:77: test.go:79: Test failed in 2.26s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714113526-TestInitContainerNotRemovedDuringInjection initcontainer_test.go:34: initcontainer_test.go:34: Performing cleanup initcontainer_test.go:35: Deleting namespaces: [bookinfo] initcontainer_test.go:35: Creating namespaces: [bookinfo] initcontainer_test.go:34: Cleanup completed in 8.29s === FAIL: pkg/tests/ossm TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod (222.30s) ior_test.go:161: ior_test.go:161: STEP 1: Ensure the IOR enabled ior_test.go:166: ior_test.go:166: STEP 2: Create 3 Gateways and they are in their own Namespace ior_test.go:176: Creating namespaces: [ns-0 ns-1 ns-2] ior_test.go:179: ior_test.go:179: STEP 3: Update SMMR to include 3 Namespaces ior_test.go:186: FATAL: Expect to find 3 Routes but found 4 instead subtest.go:23: subtest.go:25: Subtest failed in 83.71s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714113807-TestIOR-check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:151: ior_test.go:151: Performing cleanup ior_test.go:156: Deleting namespaces: [ns-0 ns-1 ns-2] ior_test.go:151: Cleanup completed in 15.36s === FAIL: pkg/tests/ossm TestIOR (382.27s) ior_test.go:41: This test verifies the behavior of IOR. ior_test.go:73: ior_test.go:73: STEP 1: Apply default SMCP and SMMR manifests ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: SUCCESS: Condition condition=Ready met by smcp istio-system/basic test.go:77: test.go:79: Test failed in 247.79s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714114025-TestIOR ior_test.go:46: ior_test.go:46: Performing cleanup ior_test.go:47: Deleting namespaces: [istio-system] ior_test.go:47: Creating namespaces: [istio-system] ior_test.go:46: Cleanup completed in 41.31s === FAIL: pkg/tests/ossm TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod (re-run 1) (224.92s) ior_test.go:161: ior_test.go:161: STEP 1: Ensure the IOR enabled ior_test.go:166: ior_test.go:166: STEP 2: Create 3 Gateways and they are in their own Namespace ior_test.go:176: Creating namespaces: [ns-0 ns-1 ns-2] ior_test.go:179: ior_test.go:179: STEP 3: Update SMMR to include 3 Namespaces ior_test.go:186: FATAL: Expect to find 3 Routes but found 4 instead subtest.go:23: subtest.go:25: Subtest failed in 81.10s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714122700-TestIOR-check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:151: ior_test.go:151: Performing cleanup ior_test.go:156: Deleting namespaces: [ns-0 ns-1 ns-2] ior_test.go:151: Cleanup completed in 16.28s === FAIL: pkg/tests/ossm TestIOR (re-run 1) (358.37s) ior_test.go:41: This test verifies the behavior of IOR. ior_test.go:73: ior_test.go:73: STEP 1: Apply default SMCP and SMMR manifests ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: SUCCESS: Condition condition=Ready met by smcp istio-system/basic test.go:77: test.go:79: Test failed in 238.39s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714122924-TestIOR ior_test.go:46: ior_test.go:46: Performing cleanup ior_test.go:47: Deleting namespaces: [istio-system] ior_test.go:47: Creating namespaces: [istio-system] ior_test.go:46: Cleanup completed in 23.38s === FAIL: pkg/tests/ossm TestIOR/check_IOR_does_not_delete_routes_after_deleting_Istio_pod (re-run 2) (227.43s) ior_test.go:161: ior_test.go:161: STEP 1: Ensure the IOR enabled ior_test.go:166: ior_test.go:166: STEP 2: Create 3 Gateways and they are in their own Namespace ior_test.go:176: Creating namespaces: [ns-0 ns-1 ns-2] ior_test.go:179: ior_test.go:179: STEP 3: Update SMMR to include 3 Namespaces ior_test.go:186: FATAL: Expect to find 3 Routes but found 4 instead subtest.go:23: subtest.go:25: Subtest failed in 83.22s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714123315-TestIOR-check_IOR_does_not_delete_routes_after_deleting_Istio_pod ior_test.go:151: ior_test.go:151: Performing cleanup ior_test.go:156: Deleting namespaces: [ns-0 ns-1 ns-2] ior_test.go:151: Cleanup completed in 16.79s === FAIL: pkg/tests/ossm TestIOR (re-run 2) (379.01s) ior_test.go:41: This test verifies the behavior of IOR. ior_test.go:73: ior_test.go:73: STEP 1: Apply default SMCP and SMMR manifests ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: Wait for condition condition=Ready on smcp istio-system/basic... ior_test.go:73: SUCCESS: Condition condition=Ready met by smcp istio-system/basic test.go:77: test.go:79: Test failed in 250.93s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/failures-must-gather/20230714123539-TestIOR ior_test.go:46: ior_test.go:46: Performing cleanup ior_test.go:47: Deleting namespaces: [istio-system] ior_test.go:47: Creating namespaces: [istio-system] ior_test.go:46: Cleanup completed in 19.48s DONE 3 runs, 136 tests, 18 skipped, 7 failures in 4385.098s ====== JUnit report file(s) v2.3: /home/jenkins/workspace/maistra/maistra-test-tool/maistra-test-tool/tests/result-20230714112402/v2.3/report.xml ====== Test summary v2.3: DONE 3 runs, 136 tests, 18 skipped, 7 failures in 4385.098s real 73m48.712s user 7m2.938s sys 2m45.751s