frherrer@frherrer-mac maistra-test-tool % SMCP_VERSION=2.4 KUBECONFIG=/Users/frherrer/repos/federation/cluster1 KUBECONFIG2=/Users/frherrer/repos/federation/cluster2 METALLB_INTERNAL_IP_ENABLED=true make test TestFederation scripts/runtests.sh TestFederation OSSM Operator version is 2.4.0 Output dir: /Users/frherrer/repos/maistra-test-tool/tests/result-20230629192925 Executing tests against SMCP version 2.4 Found TestFederation in file ./pkg/tests/ossm-federation/federation_traffic_splitting_test.go Resetting cluster by deleting namespaces used in the test suite Output dir: /Users/frherrer/repos/maistra-test-tool/tests/result-20230629192925/v2.4 ====== Executing TestFederation against SMCP v2.4 test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB operator already exists - skip installation of the operator test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB controller already exists - skip deploying MetalLB test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: IPAddressPool already exists - skip applying IPAddressPool test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB operator already exists - skip installation of the operator test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB controller already exists - skip deploying MetalLB test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: IPAddressPool already exists - skip applying IPAddressPool === RUN TestFederation federation_traffic_splitting_test.go:38: Both OC clusters are set respectively to cluster west and east if they are provided with two kubeconfig files, if not, both are set from the same file federation_common.go:63: federation_common.go:63: STEP 1: Create projects for west-mesh and east-mesh federation_common.go:64: Creating namespaces: [west-mesh-system west-mesh-bookinfo] federation_common.go:65: Creating namespaces: [east-mesh-system east-mesh-bookinfo] federation_common.go:67: federation_common.go:67: STEP 2: Install control planes for west-mesh and east-mesh federation_common.go:159: Install ServiceMeshControlPlane west-mesh in namespace west-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:159: Install ServiceMeshControlPlane east-mesh in namespace east-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:70: federation_common.go:70: STEP 3: Wait for west-mesh and east-mesh installation to complete federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: SUCCESS: Condition condition=Ready met by smcp west-mesh-system/west-mesh federation_common.go:72: Wait for condition condition=Ready on smcp east-mesh-system/east-mesh... federation_common.go:72: SUCCESS: Condition condition=Ready met by smcp east-mesh-system/east-mesh federation_common.go:74: federation_common.go:74: STEP 4: Retrieve peer addresses and ports federation_common.go:81: Using LoadBalancer service for ingress federation_common.go:88: west-mesh: address: 2620:52:0:9c:f816:3eff:fe1c:43d9; discovery port: 8188, service port: 15443 federation_common.go:89: east-mesh: address: 2620:52:0:9c:f816:3eff:fefe:923d; discovery port: 8188, service port: 15443 federation_common.go:91: federation_common.go:91: STEP 5: Retrieve root certificates federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:95: federation_common.go:95: STEP 6: Install ServiceMeshPeer and ExportedServiceSet in west-mesh federation_common.go:100: federation_common.go:100: STEP 7: Install ServiceMeshPeer and ImportedServiceSet in east-mesh federation_traffic_splitting_test.go:111: federation_traffic_splitting_test.go:111: STEP 8: Install ratings-v2 and mongodb in west-mesh federation_traffic_splitting_test.go:117: federation_traffic_splitting_test.go:117: STEP 9: Install full bookinfo in east-mesh federation_common.go:107: federation_common.go:107: STEP 10: Wait for all bookinfo pods in west-mesh and east-mesh to be ready federation_common.go:111: federation_common.go:111: STEP 11: Check if west-mesh and east-mesh are connected to each other federation_common.go:113: SUCCESS: west-mesh is connected to east-mesh federation_common.go:118: SUCCESS: east-mesh is connected to west-mesh federation_traffic_splitting_test.go:129: federation_traffic_splitting_test.go:129: STEP 12: Check if traffic is split between ratings-v1 in east-mesh and west-mesh federation_traffic_splitting_test.go:131: federation_traffic_splitting_test.go:131: STEP 13: Check if east-mesh can see services from west-mesh federation_traffic_splitting_test.go:133: SUCCESS: mongodb service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:133: SUCCESS: ratings service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:156: SUCCESS: ratings-v2 in east-mesh received 6 requests federation_traffic_splitting_test.go:162: SUCCESS: ratings-v2 in west-mesh received 4 requests test.go:77: test.go:82: Test completed in 60.00s (excluding cleanup) federation_common.go:53: federation_common.go:53: Performing cleanup federation_common.go:58: Deleting namespaces: [west-mesh-system west-mesh-bookinfo] federation_common.go:59: Deleting namespaces: [east-mesh-system east-mesh-bookinfo] federation_common.go:53: Cleanup completed in 32.79s --- PASS: TestFederation (92.79s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm-federation 96.986s DONE 1 tests in 98.075s sed: 1: "/=== Skipped/,/=== Fail ...": extra characters at the end of p command frherrer@frherrer-mac maistra-test-tool % frherrer@frherrer-mac maistra-test-tool % frherrer@frherrer-mac maistra-test-tool % frherrer@frherrer-mac maistra-test-tool % SMCP_VERSION=2.4 KUBECONFIG=/Users/frherrer/repos/federation/cluster1 KUBECONFIG2=/Users/frherrer/repos/federation/cluster2 METALLB_INTERNAL_IP_ENABLED=true make test TestFederationDifferentCerts scripts/runtests.sh TestFederationDifferentCerts OSSM Operator version is 2.4.0 Output dir: /Users/frherrer/repos/maistra-test-tool/tests/result-20230629193731 Executing tests against SMCP version 2.4 Found TestFederationDifferentCerts in file ./pkg/tests/ossm-federation/federation_traffic_splitting_test.go Resetting cluster by deleting namespaces used in the test suite Output dir: /Users/frherrer/repos/maistra-test-tool/tests/result-20230629193731/v2.4 ====== Executing TestFederationDifferentCerts against SMCP v2.4 test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB operator already exists - skip installation of the operator test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB controller already exists - skip deploying MetalLB test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: IPAddressPool already exists - skip applying IPAddressPool test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB operator already exists - skip installation of the operator test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: MetalLB controller already exists - skip deploying MetalLB test_helper_setup.go:60: Check if MetalLB controller already exists test_helper_setup.go:60: IPAddressPool already exists - skip applying IPAddressPool === RUN TestFederationDifferentCerts federation_common.go:63: federation_common.go:63: STEP 1: Create projects for west-mesh and east-mesh federation_common.go:64: Creating namespaces: [west-mesh-system west-mesh-bookinfo] federation_common.go:65: Creating namespaces: [east-mesh-system east-mesh-bookinfo] federation_common.go:67: federation_common.go:67: STEP 2: Install control planes for west-mesh and east-mesh federation_traffic_splitting_test.go:84: Create Secret 'cacerts' for custom CA certs in west-mesh federation_common.go:159: Install ServiceMeshControlPlane west-mesh in namespace west-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:159: Install ServiceMeshControlPlane east-mesh in namespace east-mesh-system federation_common.go:164: Create ServiceMeshMemberRoll federation_common.go:70: federation_common.go:70: STEP 3: Wait for west-mesh and east-mesh installation to complete federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: FAILURE: Command failed: oc wait -n west-mesh-system smcp/west-mesh --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/west-mesh error: exit status 1 federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: FAILURE: Command failed: oc wait -n west-mesh-system smcp/west-mesh --for condition=Ready --timeout 10s error: timed out waiting for the condition on servicemeshcontrolplanes/west-mesh error: exit status 1 federation_common.go:71: Wait for condition condition=Ready on smcp west-mesh-system/west-mesh... federation_common.go:71: SUCCESS: Condition condition=Ready met by smcp west-mesh-system/west-mesh federation_common.go:72: Wait for condition condition=Ready on smcp east-mesh-system/east-mesh... federation_common.go:72: SUCCESS: Condition condition=Ready met by smcp east-mesh-system/east-mesh federation_common.go:74: federation_common.go:74: STEP 4: Retrieve peer addresses and ports federation_common.go:81: Using LoadBalancer service for ingress federation_common.go:88: west-mesh: address: 2620:52:0:9c:f816:3eff:fe1c:43d9; discovery port: 8188, service port: 15443 federation_common.go:89: east-mesh: address: 2620:52:0:9c:f816:3eff:fefe:923d; discovery port: 8188, service port: 15443 federation_common.go:91: federation_common.go:91: STEP 5: Retrieve root certificates federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:153: Get key root-cert.pem from ConfigMap istio-ca-root-cert federation_common.go:95: federation_common.go:95: STEP 6: Install ServiceMeshPeer and ExportedServiceSet in west-mesh federation_common.go:100: federation_common.go:100: STEP 7: Install ServiceMeshPeer and ImportedServiceSet in east-mesh federation_traffic_splitting_test.go:111: federation_traffic_splitting_test.go:111: STEP 8: Install ratings-v2 and mongodb in west-mesh federation_traffic_splitting_test.go:117: federation_traffic_splitting_test.go:117: STEP 9: Install full bookinfo in east-mesh federation_common.go:107: federation_common.go:107: STEP 10: Wait for all bookinfo pods in west-mesh and east-mesh to be ready federation_common.go:111: federation_common.go:111: STEP 11: Check if west-mesh and east-mesh are connected to each other federation_common.go:113: SUCCESS: west-mesh is connected to east-mesh federation_common.go:118: SUCCESS: east-mesh is connected to west-mesh federation_traffic_splitting_test.go:129: federation_traffic_splitting_test.go:129: STEP 12: Check if traffic is split between ratings-v1 in east-mesh and west-mesh federation_traffic_splitting_test.go:131: federation_traffic_splitting_test.go:131: STEP 13: Check if east-mesh can see services from west-mesh federation_traffic_splitting_test.go:133: SUCCESS: mongodb service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:133: SUCCESS: ratings service from west-mesh successfully imported in east-mesh federation_traffic_splitting_test.go:156: SUCCESS: ratings-v2 in east-mesh received 3 requests federation_traffic_splitting_test.go:162: SUCCESS: ratings-v2 in west-mesh received 7 requests test.go:77: test.go:82: Test completed in 92.65s (excluding cleanup) federation_common.go:53: federation_common.go:53: Performing cleanup federation_common.go:58: Deleting namespaces: [west-mesh-system west-mesh-bookinfo] federation_common.go:59: Deleting namespaces: [east-mesh-system east-mesh-bookinfo] federation_common.go:53: Cleanup completed in 32.85s --- PASS: TestFederationDifferentCerts (125.51s) PASS ok github.com/maistra/maistra-test-tool/pkg/tests/ossm-federation 129.499s DONE 1 tests in 130.690s