scripts/runtests.sh OSSM Operator version is 2.4.0 Output dir: /go/src/maistra-test-tool/tests/result-20230814064206 Executing tests against SMCP version 2.4 WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 68 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Resetting cluster by deleting namespaces used in the test suite Output dir: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4 ====== Executing tests in group 'interop' against SMCP v2.4 test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestSMCPMultiple test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMCPMultiple (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/non-dependant 1.772s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestIstiodPodFailsAfterRestarts test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestIstiodPodFailsAfterRestarts (0.00s) === RUN TestDeployOnInfraNodes test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestDeployOnInfraNodes (0.00s) === RUN TestDiscoverySelectors test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestDiscoverySelectors (0.00s) === RUN TestInitContainerNotRemovedDuringInjection test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestInitContainerNotRemovedDuringInjection (0.00s) === RUN TestIOR test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestIOR (0.00s) === RUN TestOperatorCanUpdatePrometheusConfigMap test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOperatorCanUpdatePrometheusConfigMap (0.00s) === RUN TestRateLimiting test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestRateLimiting (0.00s) === RUN TestSMCPAddons test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMCPAddons (0.00s) === RUN TestSMCPAnnotations test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMCPAnnotations (0.00s) === RUN TestMustGather test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestMustGather (0.00s) === RUN TestTLSVersionSMCP smcp_tls_ssl_test.go:25: This test checks if the SMCP updated the tls.minProtocolVersion to TLSv1_0, TLSv1_1, and tls.maxProtocolVersion to TLSv1_3. smcp_tls_ssl_test.go:34: smcp_tls_ssl_test.go:34: STEP 1: Apply default SMCP and SMMR manifests smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:34: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:34: SUCCESS: Condition condition=Ready met by smcp istio-system/basic === RUN TestTLSVersionSMCP/minVersion_TLSv1_0 smcp_tls_ssl_test.go:37: smcp_tls_ssl_test.go:37: STEP 1: Update SMCP spec.security.controlPlane.tls.minProtocolVersion: TLSv1_0 smcp_tls_ssl_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:39: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 10.19s (excluding cleanup) --- PASS: TestTLSVersionSMCP/minVersion_TLSv1_0 (10.19s) === RUN TestTLSVersionSMCP/minVersion_TLSv1_1 smcp_tls_ssl_test.go:43: smcp_tls_ssl_test.go:43: STEP 1: Check to see if the SMCP minProtocolVersion is TLSv1_1 smcp_tls_ssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:45: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 10.36s (excluding cleanup) --- PASS: TestTLSVersionSMCP/minVersion_TLSv1_1 (10.36s) === RUN TestTLSVersionSMCP/maxVersion_TLSv1_3 smcp_tls_ssl_test.go:49: smcp_tls_ssl_test.go:49: STEP 1: Check to see if the SMCP maxProtocolVersion is TLSv1_3 smcp_tls_ssl_test.go:51: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:51: SUCCESS: Condition condition=Ready met by smcp istio-system/basic subtest.go:23: subtest.go:28: Subtest completed in 10.12s (excluding cleanup) --- PASS: TestTLSVersionSMCP/maxVersion_TLSv1_3 (10.12s) test.go:77: test.go:82: Test completed in 67.61s (excluding cleanup) smcp_tls_ssl_test.go:26: smcp_tls_ssl_test.go:26: Performing cleanup smcp_tls_ssl_test.go:31: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:31: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smcp_tls_ssl_test.go:31: Wait for condition condition=Ready on smcp istio-system/basic... smcp_tls_ssl_test.go:31: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smcp_tls_ssl_test.go:26: Cleanup completed in 10.67s --- PASS: TestTLSVersionSMCP (78.28s) === RUN TestSMMRAutoCreationAndDeletion test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestSMMRAutoCreationAndDeletion (0.00s) === RUN TestSmoke smoke_test.go:46: Smoke Test for SMCP: deploy, upgrade, bookinfo and uninstall smoke_test.go:56: Deleting namespaces: [istio-system] smoke_test.go:56: Creating namespaces: [istio-system] === RUN TestSmoke/upgrade_v2.3_to_v2.4 smoke_test.go:59: This test checks whether SMCP becomes ready after it's upgraded from v2.3 to v2.4 and bookinfo is still working after the upgrade and also test a clean installation of the target SMCP smoke_test.go:65: smoke_test.go:65: STEP 1: Install SMCP v2.3 and verify it becomes ready smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:68: smoke_test.go:68: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:69: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:69: Create Bookinfo Gateway smoke_test.go:69: Create Bookinfo Destination Rules (all) smoke_test.go:69: Create Bookinfo Deployments smoke_test.go:69: Install app "sleep" in namespace "bookinfo" smoke_test.go:69: Wait for app bookinfo/bookinfo to be ready smoke_test.go:69: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 subtest.go:23: subtest.go:25: Subtest failed in 273.74s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814065343-TestSmoke-upgrade_v2.3_to_v2.4 smoke_test.go:60: smoke_test.go:60: Performing cleanup smoke_test.go:61: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:62: Deleting namespaces: [istio-system] smoke_test.go:62: Creating namespaces: [istio-system] smoke_test.go:60: Cleanup completed in 29.45s --- FAIL: TestSmoke/upgrade_v2.3_to_v2.4 (357.16s) === RUN TestSmoke/install_smcp_v2.4 smoke_test.go:87: This test checks whether SMCP v2.4 install the SMCP version smoke_test.go:92: smoke_test.go:92: STEP 1: Install SMCP v2.4 smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:95: smoke_test.go:95: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:96: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:96: Create Bookinfo Gateway smoke_test.go:96: Create Bookinfo Destination Rules (all) smoke_test.go:96: Create Bookinfo Deployments smoke_test.go:96: Install app "sleep" in namespace "bookinfo" smoke_test.go:96: Wait for app bookinfo/bookinfo to be ready smoke_test.go:96: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 subtest.go:23: subtest.go:25: Subtest failed in 265.71s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814065932-TestSmoke-install_smcp_v2.4 smoke_test.go:88: smoke_test.go:88: Performing cleanup smoke_test.go:89: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:88: Cleanup completed in 1.58s --- FAIL: TestSmoke/install_smcp_v2.4 (321.95s) === RUN TestSmoke/delete_smcp_v2.4 smoke_test.go:102: This test checks whether SMCP v2.4 deletion deletes all the resources smoke_test.go:107: smoke_test.go:107: STEP 1: Delete SMCP and SMMR in namespace istio-system smoke_test.go:110: smoke_test.go:110: STEP 2: verify SMCP resources are deleted smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 1/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 2/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 3/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 4/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 5/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 6/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 7/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 8/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 9/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 10/60 failed. Retrying... smoke_test.go:112: FAILURE: Still waiting for resources to be deleted from namespace; expected to find the string 'No resources found in' in the output, but it wasn't found smoke_test.go:111: --- Attempt 11/60 failed. Retrying... smoke_test.go:112: SUCCESS: SMCP resources are deleted smoke_test.go:111: --- Attempt 12/60 successful; total time: 12.28s subtest.go:23: subtest.go:28: Subtest completed in 14.20s (excluding cleanup) smoke_test.go:103: smoke_test.go:103: Performing cleanup smoke_test.go:104: Deleting namespaces: [istio-system] smoke_test.go:104: Creating namespaces: [istio-system] smoke_test.go:103: Cleanup completed in 21.78s --- PASS: TestSmoke/delete_smcp_v2.4 (35.98s) test.go:77: test.go:79: Test failed in 1044.80s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814070104-TestSmoke smoke_test.go:49: smoke_test.go:49: Performing cleanup smoke_test.go:50: Deleting namespaces: [istio-system] smoke_test.go:50: Creating namespaces: [istio-system] smoke_test.go:49: Cleanup completed in 6.53s --- FAIL: TestSmoke (1064.81s) === RUN TestSSL testssl_test.go:45: testssl_test.go:45: STEP 1: Apply default SMCP and SMMR manifests testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:47: testssl_test.go:47: STEP 2: Patch SMCP to enable mTLS in dataPlane and controlPlane and set min/maxProtocolVersion, cipherSuites, and ecdhCurves testssl_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:64: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:64: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:66: testssl_test.go:66: STEP 3: Install bookinfo with mTLS and testssl pod testssl_test.go:68: Install app "bookinfo" in namespace "bookinfo" testssl_test.go:68: Create Bookinfo Gateway testssl_test.go:68: Create Bookinfo Destination Rules (all) testssl_test.go:68: Create Bookinfo Deployments testssl_test.go:68: Wait for app bookinfo/bookinfo to be ready testssl_test.go:68: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 276.52s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814070601-TestSSL testssl_test.go:31: testssl_test.go:31: Performing cleanup testssl_test.go:41: Uninstalling Bookinfo from namespace "bookinfo" testssl_test.go:31: Cleanup completed in 2.07s --- FAIL: TestSSL (330.97s) FAIL FAIL github.com/maistra/maistra-test-tool/pkg/tests/ossm 1474.334s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestClusterWideMode test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestClusterWideMode (0.00s) === RUN TestOperatorCanReconcileSMCPWhenIstiodOffline test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOperatorCanReconcileSMCPWhenIstiodOffline (0.00s) === RUN TestOperatorPodHonorsReadinessProbe test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOperatorPodHonorsReadinessProbe (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm/operator 0.463s === RUN TestMultiClusterFederationFailover test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestMultiClusterFederationFailover (0.00s) === RUN TestFederation test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestFederation (0.00s) === RUN TestFederationDifferentCerts test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestFederationDifferentCerts (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm-federation 0.004s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestCustomPrometheus test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestCustomPrometheus (0.00s) === RUN TestFederatedOpenShiftMonitoring test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestFederatedOpenShiftMonitoring (0.00s) === RUN TestOpenShiftMonitoring test.go:112: This test is being skipped because it is not part of the "interop" test group --- SKIP: TestOpenShiftMonitoring (0.00s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/tasks/observability 0.479s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAuthPolicy auth_test.go:45: auth_test.go:45: STEP 1: Apply default SMCP and SMMR manifests auth_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... auth_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic auth_test.go:47: auth_test.go:47: STEP 2: Install httpbin and sleep in multiple namespaces auth_test.go:48: Install app "httpbin" in namespace "foo" auth_test.go:48: Install app "httpbin" in namespace "bar" auth_test.go:48: Install app "httpbin" in namespace "legacy" auth_test.go:48: Install app "sleep" in namespace "foo" auth_test.go:48: Install app "sleep" in namespace "bar" auth_test.go:48: Install app "sleep" in namespace "legacy" auth_test.go:48: Wait for app foo/httpbin to be ready auth_test.go:48: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 251.18s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814071110-TestAuthPolicy auth_test.go:41: auth_test.go:41: Performing cleanup auth_test.go:42: Deleting namespaces: [foo bar legacy] auth_test.go:42: Creating namespaces: [foo bar legacy] auth_test.go:41: Cleanup completed in 14.14s --- FAIL: TestAuthPolicy (320.75s) === RUN TestMTlsMigration mtls_migration_test.go:40: mtls_migration_test.go:40: STEP 1: Apply default SMCP and SMMR manifests mtls_migration_test.go:40: Wait for condition condition=Ready on smcp istio-system/basic... mtls_migration_test.go:40: SUCCESS: Condition condition=Ready met by smcp istio-system/basic mtls_migration_test.go:42: mtls_migration_test.go:42: STEP 2: Install httpbin and sleep in multiple namespaces mtls_migration_test.go:43: Install app "httpbin" in namespace "foo" mtls_migration_test.go:43: Install app "httpbin" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "foo" mtls_migration_test.go:43: Install app "sleep" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "legacy" mtls_migration_test.go:43: Wait for app foo/httpbin to be ready mtls_migration_test.go:43: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 250.69s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814071630-TestMTlsMigration mtls_migration_test.go:36: mtls_migration_test.go:36: Performing cleanup mtls_migration_test.go:37: Deleting namespaces: [foo bar legacy] mtls_migration_test.go:37: Creating namespaces: [foo bar legacy] mtls_migration_test.go:36: Cleanup completed in 14.54s --- FAIL: TestMTlsMigration (320.37s) FAIL FAIL github.com/maistra/maistra-test-tool/pkg/tests/tasks/security/authentication 641.577s test_helper_setup.go:64: Creating namespaces: [istio-system bookinfo foo bar legacy mesh-external] === RUN TestAuthorizationDenyAllow deny_test.go:33: This test validates authorization policies with a deny action deny_test.go:35: deny_test.go:35: STEP 1: Apply default SMCP and SMMR manifests deny_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... deny_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic deny_test.go:37: deny_test.go:37: STEP 2: Install httpbin and sleep deny_test.go:38: Install app "httpbin" in namespace "foo" deny_test.go:38: Install app "sleep" in namespace "foo" deny_test.go:38: Wait for app foo/httpbin to be ready deny_test.go:38: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 249.63s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814072150-TestAuthorizationDenyAllow deny_test.go:29: deny_test.go:29: Performing cleanup deny_test.go:30: Deleting namespaces: [foo] deny_test.go:30: Creating namespaces: [foo] deny_test.go:29: Cleanup completed in 12.26s --- FAIL: TestAuthorizationDenyAllow (322.25s) === RUN TestEnvoyExtAuthzHttpExtensionProvider ext_auth_test.go:33: This test validates authorization policies with a JWT Token ext_auth_test.go:37: ext_auth_test.go:37: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:39: ext_auth_test.go:39: STEP 2: Install httpbin and sleep ext_auth_test.go:40: Install app "httpbin" in namespace "foo" ext_auth_test.go:40: Install app "sleep" in namespace "foo" ext_auth_test.go:40: Wait for app foo/httpbin to be ready ext_auth_test.go:40: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 249.30s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814072712-TestEnvoyExtAuthzHttpExtensionProvider --- FAIL: TestEnvoyExtAuthzHttpExtensionProvider (314.98s) === RUN TestEnvoyExtAuthzGrpcExtensionProvider ext_auth_test.go:115: This test validates authorization policies with a JWT Token ext_auth_test.go:119: ext_auth_test.go:119: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:119: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:119: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:121: ext_auth_test.go:121: STEP 2: Install httpbin and sleep ext_auth_test.go:122: Install app "httpbin" in namespace "foo" ext_auth_test.go:122: Install app "sleep" in namespace "foo" ext_auth_test.go:122: Wait for app foo/httpbin to be ready ext_auth_test.go:122: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 249.30s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814073227-TestEnvoyExtAuthzGrpcExtensionProvider --- FAIL: TestEnvoyExtAuthzGrpcExtensionProvider (313.21s) === RUN TestAuthorizationHTTPTraffic http_test.go:42: This test validates authorization policies for HTTP traffic. http_test.go:43: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-http/ http_test.go:45: http_test.go:45: STEP 1: Apply default SMCP and SMMR manifests http_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:47: http_test.go:47: STEP 2: Enable Service Mesh Control Plane mTLS http_test.go:53: http_test.go:53: STEP 3: Install bookinfo with mTLS http_test.go:54: Install app "bookinfo" in namespace "bookinfo" http_test.go:54: Create Bookinfo Gateway http_test.go:54: Create Bookinfo Destination Rules (all) http_test.go:54: Create Bookinfo Deployments http_test.go:54: Wait for app bookinfo/bookinfo to be ready http_test.go:54: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 250.67s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814073742-TestAuthorizationHTTPTraffic http_test.go:33: http_test.go:33: Performing cleanup http_test.go:38: Deleting namespaces: [bookinfo] http_test.go:38: Creating namespaces: [bookinfo] http_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:39: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:33: Cleanup completed in 10.44s --- FAIL: TestAuthorizationHTTPTraffic (322.27s) === Skipped === SKIP: pkg/tests/non-dependant TestSMCPMultiple (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestIstiodPodFailsAfterRestarts (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestDeployOnInfraNodes (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestDiscoverySelectors (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestInitContainerNotRemovedDuringInjection (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestIOR (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestOperatorCanUpdatePrometheusConfigMap (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestRateLimiting (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestSMCPAddons (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestSMCPAnnotations (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestMustGather (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm TestSMMRAutoCreationAndDeletion (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm-federation TestMultiClusterFederationFailover (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm-federation TestFederation (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm-federation TestFederationDifferentCerts (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm/operator TestClusterWideMode (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm/operator TestOperatorCanReconcileSMCPWhenIstiodOffline (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/ossm/operator TestOperatorPodHonorsReadinessProbe (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/tasks/observability TestCustomPrometheus (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/tasks/observability TestFederatedOpenShiftMonitoring (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === SKIP: pkg/tests/tasks/observability TestOpenShiftMonitoring (0.00s) test.go:112: This test is being skipped because it is not part of the "interop" test group === Failed === FAIL: pkg/tests/ossm TestSmoke/upgrade_v2.3_to_v2.4 (357.16s) smoke_test.go:59: This test checks whether SMCP becomes ready after it's upgraded from v2.3 to v2.4 and bookinfo is still working after the upgrade and also test a clean installation of the target SMCP smoke_test.go:65: smoke_test.go:65: STEP 1: Install SMCP v2.3 and verify it becomes ready smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:68: smoke_test.go:68: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:69: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:69: Create Bookinfo Gateway smoke_test.go:69: Create Bookinfo Destination Rules (all) smoke_test.go:69: Create Bookinfo Deployments smoke_test.go:69: Install app "sleep" in namespace "bookinfo" smoke_test.go:69: Wait for app bookinfo/bookinfo to be ready smoke_test.go:69: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 subtest.go:23: subtest.go:25: Subtest failed in 273.74s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814065343-TestSmoke-upgrade_v2.3_to_v2.4 smoke_test.go:60: smoke_test.go:60: Performing cleanup smoke_test.go:61: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:62: Deleting namespaces: [istio-system] smoke_test.go:62: Creating namespaces: [istio-system] smoke_test.go:60: Cleanup completed in 29.45s === FAIL: pkg/tests/ossm TestSmoke/install_smcp_v2.4 (321.95s) smoke_test.go:87: This test checks whether SMCP v2.4 install the SMCP version smoke_test.go:92: smoke_test.go:92: STEP 1: Install SMCP v2.4 smoke_test.go:187: smoke_test.go:187: STEP 2: Install SMCP smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 smoke_test.go:189: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:189: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:191: smoke_test.go:191: STEP 3: Check SMCP is Ready smoke_test.go:192: Wait for condition condition=Ready on smcp istio-system/basic... smoke_test.go:192: SUCCESS: Condition condition=Ready met by smcp istio-system/basic smoke_test.go:95: smoke_test.go:95: STEP 4: Install bookinfo pods and sleep pod smoke_test.go:96: Install app "bookinfo" in namespace "bookinfo" smoke_test.go:96: Create Bookinfo Gateway smoke_test.go:96: Create Bookinfo Destination Rules (all) smoke_test.go:96: Create Bookinfo Deployments smoke_test.go:96: Install app "sleep" in namespace "bookinfo" smoke_test.go:96: Wait for app bookinfo/bookinfo to be ready smoke_test.go:96: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 subtest.go:23: subtest.go:25: Subtest failed in 265.71s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814065932-TestSmoke-install_smcp_v2.4 smoke_test.go:88: smoke_test.go:88: Performing cleanup smoke_test.go:89: Uninstalling Bookinfo from namespace "bookinfo" smoke_test.go:88: Cleanup completed in 1.58s === FAIL: pkg/tests/ossm TestSmoke (1064.81s) smoke_test.go:46: Smoke Test for SMCP: deploy, upgrade, bookinfo and uninstall smoke_test.go:56: Deleting namespaces: [istio-system] smoke_test.go:56: Creating namespaces: [istio-system] test.go:77: test.go:79: Test failed in 1044.80s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814070104-TestSmoke smoke_test.go:49: smoke_test.go:49: Performing cleanup smoke_test.go:50: Deleting namespaces: [istio-system] smoke_test.go:50: Creating namespaces: [istio-system] smoke_test.go:49: Cleanup completed in 6.53s === FAIL: pkg/tests/ossm TestSSL (330.97s) testssl_test.go:45: testssl_test.go:45: STEP 1: Apply default SMCP and SMMR manifests testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:47: testssl_test.go:47: STEP 2: Patch SMCP to enable mTLS in dataPlane and controlPlane and set min/maxProtocolVersion, cipherSuites, and ecdhCurves testssl_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:64: FAILURE: Command failed: oc wait -n istio-system smcp/basic --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/basic error: exit status 1 testssl_test.go:64: Wait for condition condition=Ready on smcp istio-system/basic... testssl_test.go:64: SUCCESS: Condition condition=Ready met by smcp istio-system/basic testssl_test.go:66: testssl_test.go:66: STEP 3: Install bookinfo with mTLS and testssl pod testssl_test.go:68: Install app "bookinfo" in namespace "bookinfo" testssl_test.go:68: Create Bookinfo Gateway testssl_test.go:68: Create Bookinfo Destination Rules (all) testssl_test.go:68: Create Bookinfo Deployments testssl_test.go:68: Wait for app bookinfo/bookinfo to be ready testssl_test.go:68: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 276.52s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814070601-TestSSL testssl_test.go:31: testssl_test.go:31: Performing cleanup testssl_test.go:41: Uninstalling Bookinfo from namespace "bookinfo" testssl_test.go:31: Cleanup completed in 2.07s === FAIL: pkg/tests/tasks/security/authentication TestAuthPolicy (320.75s) auth_test.go:45: auth_test.go:45: STEP 1: Apply default SMCP and SMMR manifests auth_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... auth_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic auth_test.go:47: auth_test.go:47: STEP 2: Install httpbin and sleep in multiple namespaces auth_test.go:48: Install app "httpbin" in namespace "foo" auth_test.go:48: Install app "httpbin" in namespace "bar" auth_test.go:48: Install app "httpbin" in namespace "legacy" auth_test.go:48: Install app "sleep" in namespace "foo" auth_test.go:48: Install app "sleep" in namespace "bar" auth_test.go:48: Install app "sleep" in namespace "legacy" auth_test.go:48: Wait for app foo/httpbin to be ready auth_test.go:48: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 251.18s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814071110-TestAuthPolicy auth_test.go:41: auth_test.go:41: Performing cleanup auth_test.go:42: Deleting namespaces: [foo bar legacy] auth_test.go:42: Creating namespaces: [foo bar legacy] auth_test.go:41: Cleanup completed in 14.14s === FAIL: pkg/tests/tasks/security/authentication TestMTlsMigration (320.37s) mtls_migration_test.go:40: mtls_migration_test.go:40: STEP 1: Apply default SMCP and SMMR manifests mtls_migration_test.go:40: Wait for condition condition=Ready on smcp istio-system/basic... mtls_migration_test.go:40: SUCCESS: Condition condition=Ready met by smcp istio-system/basic mtls_migration_test.go:42: mtls_migration_test.go:42: STEP 2: Install httpbin and sleep in multiple namespaces mtls_migration_test.go:43: Install app "httpbin" in namespace "foo" mtls_migration_test.go:43: Install app "httpbin" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "foo" mtls_migration_test.go:43: Install app "sleep" in namespace "bar" mtls_migration_test.go:43: Install app "sleep" in namespace "legacy" mtls_migration_test.go:43: Wait for app foo/httpbin to be ready mtls_migration_test.go:43: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 250.69s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814071630-TestMTlsMigration mtls_migration_test.go:36: mtls_migration_test.go:36: Performing cleanup mtls_migration_test.go:37: Deleting namespaces: [foo bar legacy] mtls_migration_test.go:37: Creating namespaces: [foo bar legacy] mtls_migration_test.go:36: Cleanup completed in 14.54s === FAIL: pkg/tests/tasks/security/authorization TestAuthorizationDenyAllow (322.25s) deny_test.go:33: This test validates authorization policies with a deny action deny_test.go:35: deny_test.go:35: STEP 1: Apply default SMCP and SMMR manifests deny_test.go:35: Wait for condition condition=Ready on smcp istio-system/basic... deny_test.go:35: SUCCESS: Condition condition=Ready met by smcp istio-system/basic deny_test.go:37: deny_test.go:37: STEP 2: Install httpbin and sleep deny_test.go:38: Install app "httpbin" in namespace "foo" deny_test.go:38: Install app "sleep" in namespace "foo" deny_test.go:38: Wait for app foo/httpbin to be ready deny_test.go:38: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 249.63s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814072150-TestAuthorizationDenyAllow deny_test.go:29: deny_test.go:29: Performing cleanup deny_test.go:30: Deleting namespaces: [foo] deny_test.go:30: Creating namespaces: [foo] deny_test.go:29: Cleanup completed in 12.26s === FAIL: pkg/tests/tasks/security/authorization TestEnvoyExtAuthzHttpExtensionProvider (314.98s) ext_auth_test.go:33: This test validates authorization policies with a JWT Token ext_auth_test.go:37: ext_auth_test.go:37: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:37: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:37: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:39: ext_auth_test.go:39: STEP 2: Install httpbin and sleep ext_auth_test.go:40: Install app "httpbin" in namespace "foo" ext_auth_test.go:40: Install app "sleep" in namespace "foo" ext_auth_test.go:40: Wait for app foo/httpbin to be ready ext_auth_test.go:40: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 249.30s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814072712-TestEnvoyExtAuthzHttpExtensionProvider === FAIL: pkg/tests/tasks/security/authorization TestEnvoyExtAuthzGrpcExtensionProvider (313.21s) ext_auth_test.go:115: This test validates authorization policies with a JWT Token ext_auth_test.go:119: ext_auth_test.go:119: STEP 1: Apply default SMCP and SMMR manifests ext_auth_test.go:119: Wait for condition condition=Ready on smcp istio-system/basic... ext_auth_test.go:119: SUCCESS: Condition condition=Ready met by smcp istio-system/basic ext_auth_test.go:121: ext_auth_test.go:121: STEP 2: Install httpbin and sleep ext_auth_test.go:122: Install app "httpbin" in namespace "foo" ext_auth_test.go:122: Install app "sleep" in namespace "foo" ext_auth_test.go:122: Wait for app foo/httpbin to be ready ext_auth_test.go:122: FATAL: Command failed: kubectl -n foo rollout status deploy/httpbin --timeout=4m0s Waiting for deployment "httpbin" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 249.30s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814073227-TestEnvoyExtAuthzGrpcExtensionProvider === FAIL: pkg/tests/tasks/security/authorization TestAuthorizationHTTPTraffic (322.27s) http_test.go:42: This test validates authorization policies for HTTP traffic. http_test.go:43: Doc reference: https://istio.io/v1.14/docs/tasks/security/authorization/authz-http/ http_test.go:45: http_test.go:45: STEP 1: Apply default SMCP and SMMR manifests http_test.go:45: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:45: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:47: http_test.go:47: STEP 2: Enable Service Mesh Control Plane mTLS http_test.go:53: http_test.go:53: STEP 3: Install bookinfo with mTLS http_test.go:54: Install app "bookinfo" in namespace "bookinfo" http_test.go:54: Create Bookinfo Gateway http_test.go:54: Create Bookinfo Destination Rules (all) http_test.go:54: Create Bookinfo Deployments http_test.go:54: Wait for app bookinfo/bookinfo to be ready http_test.go:54: FATAL: Command failed: kubectl -n bookinfo rollout status deploy/details-v1 --timeout=4m0s Waiting for deployment "details-v1" rollout to finish: 0 of 1 updated replicas are available... error: timed out waiting for the condition error: exit status 1 test.go:77: test.go:79: Test failed in 250.67s (excluding cleanup) test.go:95: Capturing cluster state using must-gather registry.redhat.io/openshift-service-mesh/istio-must-gather-rhel8:2.4 test.go:99: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/failures-must-gather/20230814073742-TestAuthorizationHTTPTraffic http_test.go:33: http_test.go:33: Performing cleanup http_test.go:38: Deleting namespaces: [bookinfo] http_test.go:38: Creating namespaces: [bookinfo] http_test.go:39: Wait for condition condition=Ready on smcp istio-system/basic... http_test.go:39: SUCCESS: Condition condition=Ready met by smcp istio-system/basic http_test.go:33: Cleanup completed in 10.44s DONE 36 tests, 21 skipped, 10 failures in 3407.467s ERROR ending test run because max failures was reached ====== JUnit report file(s) v2.4: /go/src/maistra-test-tool/tests/result-20230814064206/v2.4/report.xml ====== Test summary v2.4: DONE 36 tests, 21 skipped, 10 failures in 3407.467s v2.4: ERROR ending test run because max failures was reached real 56m48.149s user 0m0.366s sys 0m0.184s Copying logs and xmls to /logs/artifacts kubectl delete ns istio-system bookinfo foo bar mesh-external legacy --ignore-not-found namespace "istio-system" deleted namespace "bookinfo" deleted namespace "foo" deleted namespace "bar" deleted namespace "mesh-external" deleted namespace "legacy" deleted