=== RUN T31 === RUN T31/federation_single_cluster_install time="2022-06-20T11:09:10Z" level=info msg="Test federation install in a single cluster" time="2022-06-20T11:09:10Z" level=info msg="Reference: https://github.com/maistra/istio/blob/maistra-2.1/pkg/servicemesh/federation/example/config-poc/install.sh" time="2022-06-20T11:09:10Z" level=info msg="Running install.sh waiting 1 min..." time="2022-06-20T11:09:10Z" level=info msg="Running command pushd ../testdata/examples/federation \\\n\t\t\t&& export MESH1_KUBECONFIG=~/.kube/config \\\n\t\t\t&& export MESH2_KUBECONFIG=~/.kube/config \\\n\t\t\t&& ./install.sh" time="2022-06-20T11:11:42Z" level=info msg="Command output: \n/opt/maistra-test-tool/testdata/examples/federation /opt/maistra-test-tool/tests\n\n##### Using the following kubeconfig files:\nmesh1: /root/.kube/config\nmesh2: /root/.kube/config\n\n##### Creating projects for mesh1\nNow using project \"mesh1-system\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\nNow using project \"mesh1-bookinfo\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\n\n##### Installing control plane for mesh1\nservicemeshcontrolplane.maistra.io/fed-export created\nservicemeshmemberroll.maistra.io/default created\nservicemeshcontrolplane.maistra.io/fed-export patched\n\n##### Creating projects for mesh2\nNow using project \"mesh2-system\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\nNow using project \"mesh2-bookinfo\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\n\n##### Installing control plane for mesh2\nservicemeshcontrolplane.maistra.io/fed-import created\nservicemeshmemberroll.maistra.io/default created\nservicemeshcontrolplane.maistra.io/fed-import patched\n\n##### Waiting for mesh1 installation to complete\nservicemeshmemberroll.maistra.io/default condition met\n\n##### Waiting for mesh2 installation to complete\nservicemeshmemberroll.maistra.io/default condition met\n\n##### Retrieving root certificates\n\n##### Retrieving ingress addresses\nSingle cluster detected; using cluster-local service for ingress\nMESH1_ADDRESS=mesh2-ingress.mesh1-system.svc.cluster.local\nMESH2_ADDRESS=mesh1-ingress.mesh2-system.svc.cluster.local\n\n##### Enabling federation for mesh1\nconfigmap/mesh2-ca-root-cert created\nservicemeshpeer.federation.maistra.io/mesh2 created\nexportedserviceset.federation.maistra.io/mesh2 created\n\n##### Enabling federation for mesh2\nconfigmap/mesh1-ca-root-cert created\nservicemeshpeer.federation.maistra.io/mesh1 created\nimportedserviceset.federation.maistra.io/mesh1 created\n\n##### Installing bookinfo in mesh1\nservice/details created\nserviceaccount/bookinfo-details created\ndeployment.apps/details-v1 created\nservice/ratings created\nserviceaccount/bookinfo-ratings created\ndeployment.apps/ratings-v1 created\nservice/reviews created\nserviceaccount/bookinfo-reviews created\ndeployment.apps/reviews-v1 created\ndeployment.apps/reviews-v2 created\ndeployment.apps/reviews-v3 created\nservice/productpage created\nserviceaccount/bookinfo-productpage created\ndeployment.apps/productpage-v1 created\nserviceaccount/bookinfo-ratings-v2 created\ndeployment.apps/ratings-v2 created\nservice/mongodb created\ndeployment.apps/mongodb-v1 created\ndestinationrule.networking.istio.io/productpage created\ndestinationrule.networking.istio.io/reviews created\ndestinationrule.networking.istio.io/ratings created\ndestinationrule.networking.istio.io/details created\n\n##### Installing bookinfo in mesh2\nservice/details created\nserviceaccount/bookinfo-details created\ndeployment.apps/details-v1 created\nservice/ratings created\nserviceaccount/bookinfo-ratings created\ndeployment.apps/ratings-v1 created\nservice/reviews created\nserviceaccount/bookinfo-reviews created\ndeployment.apps/reviews-v1 created\ndeployment.apps/reviews-v2 created\ndeployment.apps/reviews-v3 created\nservice/productpage created\nserviceaccount/bookinfo-productpage created\ndeployment.apps/productpage-v1 created\nserviceaccount/bookinfo-ratings-v2 created\ndeployment.apps/ratings-v2 created\ngateway.networking.istio.io/bookinfo-gateway created\nvirtualservice.networking.istio.io/bookinfo created\ndestinationrule.networking.istio.io/productpage created\ndestinationrule.networking.istio.io/reviews created\ndestinationrule.networking.istio.io/ratings created\ndestinationrule.networking.istio.io/details created\nvirtualservice.networking.istio.io/reviews created\n\n##### Installing mongodb k8s Service for mesh2\nservice/mongodb created\n\n##### Installing VirtualServices for mesh2\nvirtualservice.networking.istio.io/mongodb-remote created\nvirtualservice.networking.istio.io/ratings-split created\n\n##### INSTALLATION COMPLETE" time="2022-06-20T11:11:42Z" level=info msg="Waiting 40s..." time="2022-06-20T11:12:22Z" level=info msg="Verify mesh1 connection status" time="2022-06-20T11:12:22Z" level=info msg="Running command oc -n mesh1-system get servicemeshpeer mesh2 -o json" time="2022-06-20T11:12:22Z" level=info msg="Command output: \n{\n \"apiVersion\": \"federation.maistra.io/v1\",\n \"kind\": \"ServiceMeshPeer\",\n \"metadata\": {\n \"annotations\": {\n \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"federation.maistra.io/v1\\\",\\\"kind\\\":\\\"ServiceMeshPeer\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"name\\\":\\\"mesh2\\\",\\\"namespace\\\":\\\"mesh1-system\\\"},\\\"spec\\\":{\\\"gateways\\\":{\\\"egress\\\":{\\\"name\\\":\\\"mesh2-egress\\\"},\\\"ingress\\\":{\\\"name\\\":\\\"mesh2-ingress\\\"}},\\\"remote\\\":{\\\"addresses\\\":[\\\"mesh1-ingress.mesh2-system.svc.cluster.local\\\"],\\\"discoveryPort\\\":8188,\\\"servicePort\\\":15443},\\\"security\\\":{\\\"certificateChain\\\":{\\\"kind\\\":\\\"ConfigMap\\\",\\\"name\\\":\\\"mesh2-ca-root-cert\\\"},\\\"clientID\\\":\\\"mesh2.local/ns/mesh2-system/sa/mesh1-egress-service-account\\\",\\\"trustDomain\\\":\\\"mesh2.local\\\"}}}\\n\"\n },\n \"creationTimestamp\": \"2022-06-20T11:10:51Z\",\n \"generation\": 1,\n \"name\": \"mesh2\",\n \"namespace\": \"mesh1-system\",\n \"resourceVersion\": \"14803195\",\n \"selfLink\": \"/apis/federation.maistra.io/v1/namespaces/mesh1-system/servicemeshpeers/mesh2\",\n \"uid\": \"867db1f5-a085-4992-9f04-355188e9b8aa\"\n },\n \"spec\": {\n \"gateways\": {\n \"egress\": {\n \"name\": \"mesh2-egress\"\n },\n \"ingress\": {\n \"name\": \"mesh2-ingress\"\n }\n },\n \"remote\": {\n \"addresses\": [\n \"mesh1-ingress.mesh2-system.svc.cluster.local\"\n ],\n \"discoveryPort\": 8188,\n \"servicePort\": 15443\n },\n \"security\": {\n \"certificateChain\": {\n \"kind\": \"ConfigMap\",\n \"name\": \"mesh2-ca-root-cert\"\n },\n \"clientID\": \"mesh2.local/ns/mesh2-system/sa/mesh1-egress-service-account\",\n \"trustDomain\": \"mesh2.local\"\n }\n }\n}" fed_single_cluster_install.go:68: Failed to get mesh1-system connected time="2022-06-20T11:12:22Z" level=error msg="Failed to get mesh1-system connected" time="2022-06-20T11:12:22Z" level=info msg="Verify mesh2 connection status" time="2022-06-20T11:12:22Z" level=info msg="Running command oc -n mesh2-system get servicemeshpeer mesh1 -o json" time="2022-06-20T11:12:22Z" level=info msg="Command output: \n{\n \"apiVersion\": \"federation.maistra.io/v1\",\n \"kind\": \"ServiceMeshPeer\",\n \"metadata\": {\n \"annotations\": {\n \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"federation.maistra.io/v1\\\",\\\"kind\\\":\\\"ServiceMeshPeer\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"name\\\":\\\"mesh1\\\",\\\"namespace\\\":\\\"mesh2-system\\\"},\\\"spec\\\":{\\\"gateways\\\":{\\\"egress\\\":{\\\"name\\\":\\\"mesh1-egress\\\"},\\\"ingress\\\":{\\\"name\\\":\\\"mesh1-ingress\\\"}},\\\"remote\\\":{\\\"addresses\\\":[\\\"mesh2-ingress.mesh1-system.svc.cluster.local\\\"],\\\"discoveryPort\\\":8188,\\\"servicePort\\\":15443},\\\"security\\\":{\\\"certificateChain\\\":{\\\"kind\\\":\\\"ConfigMap\\\",\\\"name\\\":\\\"mesh1-ca-root-cert\\\"},\\\"clientID\\\":\\\"mesh1.local/ns/mesh1-system/sa/mesh2-egress-service-account\\\",\\\"trustDomain\\\":\\\"mesh1.local\\\"}}}\\n\"\n },\n \"creationTimestamp\": \"2022-06-20T11:10:53Z\",\n \"generation\": 1,\n \"name\": \"mesh1\",\n \"namespace\": \"mesh2-system\",\n \"resourceVersion\": \"14803246\",\n \"selfLink\": \"/apis/federation.maistra.io/v1/namespaces/mesh2-system/servicemeshpeers/mesh1\",\n \"uid\": \"73134d1d-d038-4986-a0b2-62792d28a0b8\"\n },\n \"spec\": {\n \"gateways\": {\n \"egress\": {\n \"name\": \"mesh1-egress\"\n },\n \"ingress\": {\n \"name\": \"mesh1-ingress\"\n }\n },\n \"remote\": {\n \"addresses\": [\n \"mesh2-ingress.mesh1-system.svc.cluster.local\"\n ],\n \"discoveryPort\": 8188,\n \"servicePort\": 15443\n },\n \"security\": {\n \"certificateChain\": {\n \"kind\": \"ConfigMap\",\n \"name\": \"mesh1-ca-root-cert\"\n },\n \"clientID\": \"mesh1.local/ns/mesh1-system/sa/mesh2-egress-service-account\",\n \"trustDomain\": \"mesh1.local\"\n }\n }\n}" fed_single_cluster_install.go:81: Failed to get mesh2-system connected time="2022-06-20T11:12:22Z" level=error msg="Failed to get mesh2-system connected" time="2022-06-20T11:12:22Z" level=info msg="Verify if services from mesh1 are imported into mesh2" time="2022-06-20T11:12:22Z" level=info msg="Running command oc -n mesh2-system get importedservicesets mesh1 -o json" time="2022-06-20T11:12:23Z" level=info msg="Command output: \n{\n \"apiVersion\": \"federation.maistra.io/v1\",\n \"kind\": \"ImportedServiceSet\",\n \"metadata\": {\n \"annotations\": {\n \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"federation.maistra.io/v1\\\",\\\"kind\\\":\\\"ImportedServiceSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"name\\\":\\\"mesh1\\\",\\\"namespace\\\":\\\"mesh2-system\\\"},\\\"spec\\\":{\\\"importRules\\\":[{\\\"importAsLocal\\\":false,\\\"nameSelector\\\":{\\\"alias\\\":{\\\"namespace\\\":\\\"mesh2-bookinfo\\\"},\\\"namespace\\\":\\\"bookinfo\\\"},\\\"type\\\":\\\"NameSelector\\\"}]}}\\n\"\n },\n \"creationTimestamp\": \"2022-06-20T11:10:54Z\",\n \"generation\": 1,\n \"name\": \"mesh1\",\n \"namespace\": \"mesh2-system\",\n \"resourceVersion\": \"14804674\",\n \"selfLink\": \"/apis/federation.maistra.io/v1/namespaces/mesh2-system/importedservicesets/mesh1\",\n \"uid\": \"c30cbf9d-ddc3-4b02-ac51-ec0d3e9358fe\"\n },\n \"spec\": {\n \"importRules\": [\n {\n \"importAsLocal\": false,\n \"nameSelector\": {\n \"alias\": {\n \"namespace\": \"mesh2-bookinfo\"\n },\n \"namespace\": \"bookinfo\"\n },\n \"type\": \"NameSelector\"\n }\n ]\n },\n \"status\": {\n \"importedServices\": [\n {\n \"exportedName\": \"mongodb.bookinfo.svc.mesh2-exports.local\",\n \"localService\": {\n \"hostname\": \"mongodb.mesh2-bookinfo.svc.mesh1-imports.local\",\n \"name\": \"mongodb\",\n \"namespace\": \"mesh2-bookinfo\"\n }\n },\n {\n \"exportedName\": \"ratings.bookinfo.svc.mesh2-exports.local\",\n \"localService\": {\n \"hostname\": \"ratings.mesh2-bookinfo.svc.mesh1-imports.local\",\n \"name\": \"ratings\",\n \"namespace\": \"mesh2-bookinfo\"\n }\n }\n ]\n }\n}" time="2022-06-20T11:12:23Z" level=info msg="mesh2-system gets both mongodb and ratings services from mesh1" time="2022-06-20T11:12:23Z" level=info msg="Cleanup ..." time="2022-06-20T11:12:23Z" level=info msg="Running command pushd ../testdata/examples/federation \\\n\t\t\t&& export MESH1_KUBECONFIG=~/.kube/config \\\n\t\t\t&& export MESH2_KUBECONFIG=~/.kube/config \\\n\t\t\t&& ./cleanup.sh" time="2022-06-20T11:15:53Z" level=info msg="Command output: \n/opt/maistra-test-tool/testdata/examples/federation /opt/maistra-test-tool/tests\n\n##### Using the following kubeconfig files:\nmesh1: /root/.kube/config\nmesh2: /root/.kube/config\nservicemeshpeer.federation.maistra.io \"mesh2\" deleted\nservicemeshpeer.federation.maistra.io \"mesh1\" deleted\nnamespace \"mesh1-system\" deleted\nnamespace \"mesh2-system\" deleted\nnamespace \"mesh1-bookinfo\" deleted\nnamespace \"mesh2-bookinfo\" deleted" --- FAIL: T31 (422.62s) --- FAIL: T31/federation_single_cluster_install (192.68s) === RUN T32 === RUN T32/federation_single_cluster_different_cert_install time="2022-06-20T11:16:13Z" level=info msg="Test federation install in a single cluster" time="2022-06-20T11:16:13Z" level=info msg="Reference: https://github.com/maistra/istio/blob/maistra-2.1/pkg/servicemesh/federation/example/config-poc/install.sh" time="2022-06-20T11:16:13Z" level=info msg="Running install_diff_cert.sh waiting 1 min..." time="2022-06-20T11:16:13Z" level=info msg="Running command pushd ../testdata/examples/federation \\\n\t\t\t&& export MESH1_KUBECONFIG=~/.kube/config \\\n\t\t\t&& export MESH2_KUBECONFIG=~/.kube/config \\\n\t\t\t&& ./install_diff_cert.sh" time="2022-06-20T11:18:29Z" level=info msg="Command output: \n/opt/maistra-test-tool/testdata/examples/federation /opt/maistra-test-tool/tests\n\n##### Using the following kubeconfig files:\nmesh1: /root/.kube/config\nmesh2: /root/.kube/config\n\n##### Creating projects for mesh1\nNow using project \"mesh1-system\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\nNow using project \"mesh1-bookinfo\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\n\n##### Configure mesh1 smcp for using different root cert\nsecret/cacerts created\n\n##### Installing control plane for mesh1\nservicemeshcontrolplane.maistra.io/fed-export created\nservicemeshmemberroll.maistra.io/default created\nservicemeshcontrolplane.maistra.io/fed-export patched\n\n##### Creating projects for mesh2\nNow using project \"mesh2-system\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\nNow using project \"mesh2-bookinfo\" on server \"https://api.ryan-kiali-p.maistra.upshift.redhat.com:6443\".\n\nYou can add applications to this project with the 'new-app' command. For example, try:\n\n oc new-app rails-postgresql-example\n\nto build a new example application in Ruby. Or use kubectl to deploy a simple Kubernetes application:\n\n kubectl create deployment hello-node --image=k8s.gcr.io/e2e-test-images/agnhost:2.33 -- /agnhost serve-hostname\n\n\n##### Installing control plane for mesh2\nservicemeshcontrolplane.maistra.io/fed-import created\nservicemeshmemberroll.maistra.io/default created\nservicemeshcontrolplane.maistra.io/fed-import patched\n\n##### Waiting for mesh1 installation to complete\nservicemeshmemberroll.maistra.io/default condition met\n\n##### Waiting for mesh2 installation to complete\nservicemeshmemberroll.maistra.io/default condition met\n\n##### Retrieving root certificates\n\n##### Retrieving ingress addresses\nSingle cluster detected; using cluster-local service for ingress\nMESH1_ADDRESS=mesh2-ingress.mesh1-system.svc.cluster.local\nMESH2_ADDRESS=mesh1-ingress.mesh2-system.svc.cluster.local\n\n##### Enabling federation for mesh1\nconfigmap/mesh2-ca-root-cert created\nservicemeshpeer.federation.maistra.io/mesh2 created\nexportedserviceset.federation.maistra.io/mesh2 created\n\n##### Enabling federation for mesh2\nconfigmap/mesh1-ca-root-cert created\nservicemeshpeer.federation.maistra.io/mesh1 created\nimportedserviceset.federation.maistra.io/mesh1 created\n\n##### Installing bookinfo in mesh1\nservice/details created\nserviceaccount/bookinfo-details created\ndeployment.apps/details-v1 created\nservice/ratings created\nserviceaccount/bookinfo-ratings created\ndeployment.apps/ratings-v1 created\nservice/reviews created\nserviceaccount/bookinfo-reviews created\ndeployment.apps/reviews-v1 created\ndeployment.apps/reviews-v2 created\ndeployment.apps/reviews-v3 created\nservice/productpage created\nserviceaccount/bookinfo-productpage created\ndeployment.apps/productpage-v1 created\nserviceaccount/bookinfo-ratings-v2 created\ndeployment.apps/ratings-v2 created\nservice/mongodb created\ndeployment.apps/mongodb-v1 created\ndestinationrule.networking.istio.io/productpage created\ndestinationrule.networking.istio.io/reviews created\ndestinationrule.networking.istio.io/ratings created\ndestinationrule.networking.istio.io/details created\n\n##### Installing bookinfo in mesh2\nservice/details created\nserviceaccount/bookinfo-details created\ndeployment.apps/details-v1 created\nservice/ratings created\nserviceaccount/bookinfo-ratings created\ndeployment.apps/ratings-v1 created\nservice/reviews created\nserviceaccount/bookinfo-reviews created\ndeployment.apps/reviews-v1 created\ndeployment.apps/reviews-v2 created\ndeployment.apps/reviews-v3 created\nservice/productpage created\nserviceaccount/bookinfo-productpage created\ndeployment.apps/productpage-v1 created\nserviceaccount/bookinfo-ratings-v2 created\ndeployment.apps/ratings-v2 created\ngateway.networking.istio.io/bookinfo-gateway created\nvirtualservice.networking.istio.io/bookinfo created\ndestinationrule.networking.istio.io/productpage created\ndestinationrule.networking.istio.io/reviews created\ndestinationrule.networking.istio.io/ratings created\ndestinationrule.networking.istio.io/details created\nvirtualservice.networking.istio.io/reviews created\n\n##### Installing mongodb k8s Service for mesh2\nservice/mongodb created\n\n##### Installing VirtualServices for mesh2\nvirtualservice.networking.istio.io/mongodb-remote created\nvirtualservice.networking.istio.io/ratings-split created\n\n##### INSTALLATION COMPLETE" time="2022-06-20T11:18:29Z" level=info msg="Waiting 2 minutes..." time="2022-06-20T11:20:29Z" level=info msg="Verify mesh1 connection status" time="2022-06-20T11:20:29Z" level=info msg="Running command oc -n mesh1-system get servicemeshpeer mesh2 -o json" time="2022-06-20T11:20:30Z" level=info msg="Command output: \n{\n \"apiVersion\": \"federation.maistra.io/v1\",\n \"kind\": \"ServiceMeshPeer\",\n \"metadata\": {\n \"annotations\": {\n \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"federation.maistra.io/v1\\\",\\\"kind\\\":\\\"ServiceMeshPeer\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"name\\\":\\\"mesh2\\\",\\\"namespace\\\":\\\"mesh1-system\\\"},\\\"spec\\\":{\\\"gateways\\\":{\\\"egress\\\":{\\\"name\\\":\\\"mesh2-egress\\\"},\\\"ingress\\\":{\\\"name\\\":\\\"mesh2-ingress\\\"}},\\\"remote\\\":{\\\"addresses\\\":[\\\"mesh1-ingress.mesh2-system.svc.cluster.local\\\"],\\\"discoveryPort\\\":8188,\\\"servicePort\\\":15443},\\\"security\\\":{\\\"certificateChain\\\":{\\\"kind\\\":\\\"ConfigMap\\\",\\\"name\\\":\\\"mesh2-ca-root-cert\\\"},\\\"clientID\\\":\\\"mesh2.local/ns/mesh2-system/sa/mesh1-egress-service-account\\\",\\\"trustDomain\\\":\\\"mesh2.local\\\"}}}\\n\"\n },\n \"creationTimestamp\": \"2022-06-20T11:17:45Z\",\n \"generation\": 1,\n \"name\": \"mesh2\",\n \"namespace\": \"mesh1-system\",\n \"resourceVersion\": \"14815973\",\n \"selfLink\": \"/apis/federation.maistra.io/v1/namespaces/mesh1-system/servicemeshpeers/mesh2\",\n \"uid\": \"4e359618-2c2e-4b2d-a843-06145c293006\"\n },\n \"spec\": {\n \"gateways\": {\n \"egress\": {\n \"name\": \"mesh2-egress\"\n },\n \"ingress\": {\n \"name\": \"mesh2-ingress\"\n }\n },\n \"remote\": {\n \"addresses\": [\n \"mesh1-ingress.mesh2-system.svc.cluster.local\"\n ],\n \"discoveryPort\": 8188,\n \"servicePort\": 15443\n },\n \"security\": {\n \"certificateChain\": {\n \"kind\": \"ConfigMap\",\n \"name\": \"mesh2-ca-root-cert\"\n },\n \"clientID\": \"mesh2.local/ns/mesh2-system/sa/mesh1-egress-service-account\",\n \"trustDomain\": \"mesh2.local\"\n }\n },\n \"status\": {\n \"discoveryStatus\": {\n \"active\": [\n {\n \"pod\": \"istiod-fed-export-568d74bc48-kl4h2\",\n \"remotes\": [\n {\n \"connected\": true,\n \"lastConnected\": \"2022-06-20T11:19:21Z\",\n \"lastDisconnect\": \"2022-06-20T11:19:15Z\",\n \"lastEvent\": \"2022-06-20T11:18:30Z\",\n \"lastFullSync\": \"2022-06-20T11:19:22Z\",\n \"source\": \"10.129.2.119\"\n }\n ],\n \"watch\": {\n \"connected\": true,\n \"lastConnected\": \"2022-06-20T11:17:46Z\",\n \"lastDisconnectStatus\": \"Get \\\"http://mesh2-egress.mesh1-system.svc.cluster.local:8188/v1/watch\\\": dial tcp 172.30.251.186:8188: connect: connection refused\",\n \"lastFullSync\": \"2022-06-20T11:18:03Z\"\n }\n }\n ]\n }\n }\n}" time="2022-06-20T11:20:30Z" level=info msg="mesh1-system connected true" time="2022-06-20T11:20:30Z" level=info msg="Verify mesh2 connection status" time="2022-06-20T11:20:30Z" level=info msg="Running command oc -n mesh2-system get servicemeshpeer mesh1 -o json" time="2022-06-20T11:20:30Z" level=info msg="Command output: \n{\n \"apiVersion\": \"federation.maistra.io/v1\",\n \"kind\": \"ServiceMeshPeer\",\n \"metadata\": {\n \"annotations\": {\n \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"federation.maistra.io/v1\\\",\\\"kind\\\":\\\"ServiceMeshPeer\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"name\\\":\\\"mesh1\\\",\\\"namespace\\\":\\\"mesh2-system\\\"},\\\"spec\\\":{\\\"gateways\\\":{\\\"egress\\\":{\\\"name\\\":\\\"mesh1-egress\\\"},\\\"ingress\\\":{\\\"name\\\":\\\"mesh1-ingress\\\"}},\\\"remote\\\":{\\\"addresses\\\":[\\\"mesh2-ingress.mesh1-system.svc.cluster.local\\\"],\\\"discoveryPort\\\":8188,\\\"servicePort\\\":15443},\\\"security\\\":{\\\"certificateChain\\\":{\\\"kind\\\":\\\"ConfigMap\\\",\\\"name\\\":\\\"mesh1-ca-root-cert\\\"},\\\"clientID\\\":\\\"mesh1.local/ns/mesh1-system/sa/mesh2-egress-service-account\\\",\\\"trustDomain\\\":\\\"mesh1.local\\\"}}}\\n\"\n },\n \"creationTimestamp\": \"2022-06-20T11:17:47Z\",\n \"generation\": 1,\n \"name\": \"mesh1\",\n \"namespace\": \"mesh2-system\",\n \"resourceVersion\": \"14814257\",\n \"selfLink\": \"/apis/federation.maistra.io/v1/namespaces/mesh2-system/servicemeshpeers/mesh1\",\n \"uid\": \"596b8869-ce45-4b18-ab5a-8e87e8f4dcfe\"\n },\n \"spec\": {\n \"gateways\": {\n \"egress\": {\n \"name\": \"mesh1-egress\"\n },\n \"ingress\": {\n \"name\": \"mesh1-ingress\"\n }\n },\n \"remote\": {\n \"addresses\": [\n \"mesh2-ingress.mesh1-system.svc.cluster.local\"\n ],\n \"discoveryPort\": 8188,\n \"servicePort\": 15443\n },\n \"security\": {\n \"certificateChain\": {\n \"kind\": \"ConfigMap\",\n \"name\": \"mesh1-ca-root-cert\"\n },\n \"clientID\": \"mesh1.local/ns/mesh1-system/sa/mesh2-egress-service-account\",\n \"trustDomain\": \"mesh1.local\"\n }\n }\n}" fed_single_cluster_test_diff_cert.go:73: Failed to get mesh2-system connected time="2022-06-20T11:20:30Z" level=error msg="Failed to get mesh2-system connected" time="2022-06-20T11:20:30Z" level=info msg="Verify if services from mesh1 are imported into mesh2" time="2022-06-20T11:20:30Z" level=info msg="Running command oc -n mesh2-system get importedservicesets mesh1 -o json" time="2022-06-20T11:20:30Z" level=info msg="Command output: \n{\n \"apiVersion\": \"federation.maistra.io/v1\",\n \"kind\": \"ImportedServiceSet\",\n \"metadata\": {\n \"annotations\": {\n \"kubectl.kubernetes.io/last-applied-configuration\": \"{\\\"apiVersion\\\":\\\"federation.maistra.io/v1\\\",\\\"kind\\\":\\\"ImportedServiceSet\\\",\\\"metadata\\\":{\\\"annotations\\\":{},\\\"name\\\":\\\"mesh1\\\",\\\"namespace\\\":\\\"mesh2-system\\\"},\\\"spec\\\":{\\\"importRules\\\":[{\\\"importAsLocal\\\":false,\\\"nameSelector\\\":{\\\"alias\\\":{\\\"namespace\\\":\\\"mesh2-bookinfo\\\"},\\\"namespace\\\":\\\"bookinfo\\\"},\\\"type\\\":\\\"NameSelector\\\"}]}}\\n\"\n },\n \"creationTimestamp\": \"2022-06-20T11:17:47Z\",\n \"generation\": 1,\n \"name\": \"mesh1\",\n \"namespace\": \"mesh2-system\",\n \"resourceVersion\": \"14815977\",\n \"selfLink\": \"/apis/federation.maistra.io/v1/namespaces/mesh2-system/importedservicesets/mesh1\",\n \"uid\": \"49d48675-6d4b-47dc-934a-52fa91fa6b48\"\n },\n \"spec\": {\n \"importRules\": [\n {\n \"importAsLocal\": false,\n \"nameSelector\": {\n \"alias\": {\n \"namespace\": \"mesh2-bookinfo\"\n },\n \"namespace\": \"bookinfo\"\n },\n \"type\": \"NameSelector\"\n }\n ]\n },\n \"status\": {\n \"importedServices\": [\n {\n \"exportedName\": \"mongodb.bookinfo.svc.mesh2-exports.local\",\n \"localService\": {\n \"hostname\": \"mongodb.mesh2-bookinfo.svc.mesh1-imports.local\",\n \"name\": \"mongodb\",\n \"namespace\": \"mesh2-bookinfo\"\n }\n },\n {\n \"exportedName\": \"ratings.bookinfo.svc.mesh2-exports.local\",\n \"localService\": {\n \"hostname\": \"ratings.mesh2-bookinfo.svc.mesh1-imports.local\",\n \"name\": \"ratings\",\n \"namespace\": \"mesh2-bookinfo\"\n }\n }\n ]\n }\n}" time="2022-06-20T11:20:30Z" level=info msg="mesh2-system gets both mongodb and ratings services from mesh1" time="2022-06-20T11:20:30Z" level=info msg="Cleanup ..." time="2022-06-20T11:20:30Z" level=info msg="Running command kubectl -n mesh1-system delete secret cacerts" time="2022-06-20T11:20:30Z" level=info msg="Command output: \nsecret \"cacerts\" deleted" time="2022-06-20T11:20:30Z" level=info msg="Running command pushd ../testdata/examples/federation \\\n\t\t\t&& export MESH1_KUBECONFIG=~/.kube/config \\\n\t\t\t&& export MESH2_KUBECONFIG=~/.kube/config \\\n\t\t\t&& ./cleanup.sh" time="2022-06-20T11:24:04Z" level=info msg="Command output: \n/opt/maistra-test-tool/testdata/examples/federation /opt/maistra-test-tool/tests\n\n##### Using the following kubeconfig files:\nmesh1: /root/.kube/config\nmesh2: /root/.kube/config\nservicemeshpeer.federation.maistra.io \"mesh2\" deleted\nservicemeshpeer.federation.maistra.io \"mesh1\" deleted\nnamespace \"mesh1-system\" deleted\nnamespace \"mesh2-system\" deleted\nnamespace \"mesh1-bookinfo\" deleted\nnamespace \"mesh2-bookinfo\" deleted" --- FAIL: T32 (491.46s) --- FAIL: T32/federation_single_cluster_different_cert_install (257.70s)