exec: [go test -json -tags=integ -timeout 180m ./tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 326894 2025-12-09T12:46:00.548797Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:46:00.548862Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:46:00.580792Z info tf === Test Framework Settings === 2025-12-09T12:46:00.580861Z info tf TestID: security_ca_custom_root RunID: 2481ac1f-d34b-406b-8c27-ef307affe393 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:46:00.580870Z info tf =============================== 2025-12-09T12:46:00.581207Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-2481ac1 2025-12-09T12:46:00.581289Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:46:00.581302Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:46:00.581318Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:46:00.581329Z info tf === BEGIN: Building clusters === 2025-12-09T12:46:00.584257Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:46:00.584265Z info tf === DONE: Building clusters === 2025-12-09T12:46:00.584280Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:46:00.613512Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:46:00.613572Z info tf === SUCCESS: context setup function === 2025-12-09T12:46:00.613583Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:46:00.613596Z info tf === Istio Component Config === 2025-12-09T12:46:00.613649Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:46:00.613656Z info tf ================================ 2025-12-09T12:46:00.617629Z info tf skipping deployment as specified in the config 2025-12-09T12:46:00.617650Z info tf === SUCCEEDED: Deploy Istio in 4.061021ms [Suite=security_ca_custom_root]=== 2025-12-09T12:46:00.617661Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:46:00.706074Z info tf === SUCCEEDED: Create namespace echo1 in 88.407867ms === Generating RSA private key, 2048 bit long modulus (2 primes) **************************************************************************************************+++++ **************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-2481ac1/_suite_context/ca-custom-root-3476539827/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ **********************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-2481ac1/_suite_context/ca-custom-root-3476539827/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ***********************************************************************************************************************************************************************************************************************************************************************************************************************+++++ **********************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-2481ac1/_suite_context/ca-custom-root-3476539827/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:46:01.906235Z info tf === BEGIN: Create namespace external === 2025-12-09T12:46:01.920356Z info tf === SUCCEEDED: Create namespace external in 14.122839ms === 2025-12-09T12:46:02.025392Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:46:03.103485Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.119165Z info sync complete name=pod controller attempt=4 time=15.574932ms 2025-12-09T12:46:03.120872Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.137164Z info sync complete name=pod controller attempt=4 time=16.227173ms 2025-12-09T12:46:03.137553Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.153810Z info sync complete name=pod controller attempt=4 time=16.195618ms 2025-12-09T12:46:03.167628Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.172307Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.174367Z info sync complete name=pod controller attempt=3 time=6.616182ms 2025-12-09T12:46:03.178890Z info sync complete name=pod controller attempt=3 time=6.52694ms 2025-12-09T12:46:03.185432Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.187574Z info sync complete name=pod controller attempt=2 time=2.09017ms 2025-12-09T12:46:03.189850Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.203740Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.204655Z info sync complete name=pod controller attempt=4 time=14.762567ms 2025-12-09T12:46:03.210041Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.212239Z info sync complete name=pod controller attempt=2 time=2.113291ms 2025-12-09T12:46:03.221066Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.236434Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.237905Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.238309Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.238607Z info sync complete name=pod controller attempt=2 time=2.107761ms 2025-12-09T12:46:03.240397Z info sync complete name=pod controller attempt=2 time=2.039373ms 2025-12-09T12:46:03.244420Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.246547Z info sync complete name=pod controller attempt=2 time=2.071558ms 2025-12-09T12:46:03.266282Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.267774Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.269079Z info sync complete name=pod controller attempt=2 time=2.759114ms 2025-12-09T12:46:03.273042Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.285432Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.285493Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.286137Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:46:03.290589Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.310679Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.316516Z info sync complete name=pod controller attempt=5 time=31.008914ms 2025-12-09T12:46:03.317930Z info sync complete name=pod controller attempt=5 time=31.742543ms 2025-12-09T12:46:03.337575Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.339136Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.344528Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.367144Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.386244Z info klog Caches are synced controller=echo 2025-12-09T12:46:03.386267Z info klog Caches are synced controller=echo 2025-12-09T12:46:14.445547Z info tf === SUCCEEDED: Deploy echo instances in 12.420149112s === 2025-12-09T12:46:14.478312Z info tf === DONE: Setup: 'security_ca_custom_root' (13.894022153s) === 2025-12-09T12:46:14.478338Z info tf === BEGIN: Test Run: 'security_ca_custom_root' === PASS tests/integration/security/ca_custom_root.TestMultiRootSetup/From_primary-0/server:server-naked-foo-alt[success] (1.01s) PASS tests/integration/security/ca_custom_root.TestMultiRootSetup/From_primary-0 (1.01s) PASS tests/integration/security/ca_custom_root.TestMultiRootSetup (1.05s) === RUN TestSecureNaming 2025-12-09T12:46:15.524904Z info tf === BEGIN: Test: 'security_ca_custom_root[TestSecureNaming]' === secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:114: retry.UntilSuccessOrFail: timeout while waiting after 10 attempts (last error: CA certificate (-----BEGIN CERTIFICATE----- MIIC/TCCAeWgAwIBAgIRAKqk5v6yt+PqhmaTeHc8OOEwDQYJKoZIhvcNAQELBQAw GDEWMBQGA1UEChMNY2x1c3Rlci5sb2NhbDAeFw0yNTEyMDkxMjQyMTZaFw0zNTEy MDcxMjQyMTZaMBgxFjAUBgNVBAoTDWNsdXN0ZXIubG9jYWwwggEiMA0GCSqGSIb3 DQEBAQUAA4IBDwAwggEKAoIBAQDRHY2QPowIXQnoP26H4VEO0Pikg7f4lrGO6oEt Nk7pYPlo2YT5cm9XYzMIgAbkp5XcQg0evTk5ZBCQ4yxInKMvk5vd6oTMKm+70T+Y cjXOMSApj9/tPu0I3ibsF40RrH7Zyl7WCQ7B2dA0OXbfpGWFIs/9pjYlyUAVefNk ow7TJXBxjHDGY3LY7MPLIvWovSJf0LrC9K7+EYCA1tYP74yEzR0VE2yX2tbfZVqt f5KTHjaCV601kD8nKBF6P52uuIkv6agQ7mES9W4lzIUEUQ+urTNojPRxOHAAHj+A ITs+/nJMyrDofPB6zH7qWM62TDbGK1ShBwgkJLyHifV5zQQ5AgMBAAGjQjBAMA4G A1UdDwEB/wQEAwICBDAPBgNVHRMBAf8EBTADAQH/MB0GA1UdDgQWBBQ731kdBEtM 79mTlo5IgtJyuAdMNDANBgkqhkiG9w0BAQsFAAOCAQEAOR0Ue1b0C9vsBGgHnaTN +9uOnR+yppYZb9X9apXRQ9fNpZOlj8AmDCmbWiyG8Y3uK/9J0uwxm5MupCOWOi3W qOUQF16WucwQpEvA/inT4axK2SOwEVJglcmeXPNVN0UfPZasdCAWgJ1oufb9C8d/ b7DkNXN4/qGRAONhGUEAn07I2cQmI3WTlSEmL4bt4NpoKlPj1OwSpZ1IlMjEef+M gq3Om7GSZ8hrfaDTac7KtsALDLZaqHdHzaR1c5OD47vDK48xq9zfwVhyBbKHe3FD iM2MNNOAOAjQp91Ai73NQATSPSwlw0knZO/TpmU4smZna41hcaasF3F6v9a4M89T Gw== -----END CERTIFICATE----- ) not matching plugin cert (-----BEGIN CERTIFICATE----- MIID7TCCAtWgAwIBAgIJAOIRDhOcxsx6MA0GCSqGSIb3DQEBCwUAMIGLMQswCQYD VQQGEwJVUzETMBEGA1UECAwKQ2FsaWZvcm5pYTESMBAGA1UEBwwJU3Vubnl2YWxl MQ4wDAYDVQQKDAVJc3RpbzENMAsGA1UECwwEVGVzdDEQMA4GA1UEAwwHUm9vdCBD QTEiMCAGCSqGSIb3DQEJARYTdGVzdHJvb3RjYUBpc3Rpby5pbzAgFw0xODAxMjQx OTE1NTFaGA8yMTE3MTIzMTE5MTU1MVowgYsxCzAJBgNVBAYTAlVTMRMwEQYDVQQI DApDYWxpZm9ybmlhMRIwEAYDVQQHDAlTdW5ueXZhbGUxDjAMBgNVBAoMBUlzdGlv MQ0wCwYDVQQLDARUZXN0MRAwDgYDVQQDDAdSb290IENBMSIwIAYJKoZIhvcNAQkB FhN0ZXN0cm9vdGNhQGlzdGlvLmlvMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB CgKCAQEA38uEfAatzQYqbaLou1nxJ348VyNzumYMmDDt5pbLYRrCo2pS3ki1ZVDN 8yxIENJFkpKw9UctTGdbNGuGCiSDP7uqF6BiVn+XKAU/3pnPFBbTd0S33NqbDEQu IYraHSl/tSk5rARbC1DrQRdZ6nYD2KrapC4g0XbjY6Pu5l4y7KnFwSunnp9uqpZw uERv/BgumJ5QlSeSeCmhnDhLxooG8w5tC2yVr1yDpsOHGimP/mc8Cds4V0zfIhQv YzfIHphhE9DKjmnjBYLOdj4aycv44jHnOGc+wvA1Jqsl60t3wgms+zJTiWwABLdw zgMAa7yxLyoV0+PiVQud6k+8ZoIFcwIDAQABo1AwTjAdBgNVHQ4EFgQUOUYGtUyh euxO4lGe4Op1y8NVoagwHwYDVR0jBBgwFoAUOUYGtUyheuxO4lGe4Op1y8NVoagw DAYDVR0TBAUwAwEB/zANBgkqhkiG9w0BAQsFAAOCAQEANXLyfAs7J9rmBamGJvPZ ltx390WxzzLFQsBRAaH6rgeipBq3dR9qEjAwb6BTF+ROmtQzX+fjstCRrJxCto9W tC8KvXTdRfIjfCCZjhtIOBKqRxE4KJV/RBfv9xD5lyjtCPCQl3Ia6MSf42N+abAK WCdU6KCojA8WB9YhSCzza3aQbPTzd26OC/JblJpVgtus5f8ILzCsz+pbMimgTkhy AuhYRppJaQ24APijsEC9+GIaVKPg5IwWroiPoj+QXNpshuvqVQQXvGaRiq4zoSnx xAJz+w8tjrDWcf826VN14IL+/Cmqlg/rIfB5CHdwVIfWwpuGB66q/UiPegZMNs8a 3g== -----END CERTIFICATE----- )) 2025-12-09T12:46:25.531776Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestSecureNaming] (10.006866842s)' === 2025-12-09T12:46:25.531870Z error tf === Dumping Namespace external State for TestSecureNaming... 2025-12-09T12:46:25.531883Z error tf === Dumping Istio Deployment State for TestSecureNaming... 2025-12-09T12:46:25.531898Z error tf === Dumping Namespace echo1 State for TestSecureNaming... 2025-12-09T12:46:25.666512Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:15Z/14f388a56c-0ac6-41ff-a168-069b3ac84c70 2025-12-09T12:46:25.666719Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1346s 2025-12-09T12:46:25.667945Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:25.769487Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:15Z/142050a543-8957-4c0c-b0c6-1abbf8cd8dbf 2025-12-09T12:46:25.769617Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2375s 2025-12-09T12:46:25.770430Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:25.862169Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:15Z/141527386b-583c-4ffc-8203-4d61b0e9d3c9 2025-12-09T12:46:25.862261Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3300s 2025-12-09T12:46:25.862920Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:26.007103Z error tf === Dumping Namespace istio-system State for TestSecureNaming... --- FAIL: TestSecureNaming (10.87s) FAIL tests/integration/security/ca_custom_root.TestSecureNaming (10.87s) === RUN TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] 2025-12-09T12:46:26.414005Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]]' === test.go:322: failed calling client (cluster=cluster-0)->'http://server-naked-foo:443': call failed from client (cluster=cluster-0) to http://server-naked-foo:443 (using http): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "http://server-naked-foo:443": read tcp 172.21.3.248:59686->172.30.242.142:443: read: connection reset by peer 2025-12-09T12:46:56.414492Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]] (30.000483286s)' === 2025-12-09T12:46:56.414558Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:46:56.414579Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:46:56.414567Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:46:56.710031Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/153b3daac6-dad8-46ce-8070-966565d50117 2025-12-09T12:46:56.710173Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2953s 2025-12-09T12:46:56.710866Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:56.832025Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15a8ab0c66-e405-4f78-ad98-ed1b9a3c49a4 2025-12-09T12:46:56.832389Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4175s 2025-12-09T12:46:56.832977Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:56.918920Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/1527b7a6c4-ca31-4cc0-9b55-e83a1108b5c8 2025-12-09T12:46:56.919078Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5042s 2025-12-09T12:46:56.919930Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (30.61s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (30.61s) PASS tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-bar[fail] (0.03s) === RUN TestTrustDomainAliasSecureNaming/From_primary-0 2025-12-09T12:46:26.413750Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0]' === 2025-12-09T12:46:57.048834Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0] (30.635082588s)' === 2025-12-09T12:46:57.048896Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:46:57.048906Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:46:57.048903Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:46:57.266617Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/159d13da93-e261-4669-94ae-87fb1f0bda70 2025-12-09T12:46:57.267064Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2178s 2025-12-09T12:46:57.267582Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:57.403804Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15aee34fd6-3c2b-485f-9d87-538c9d562cde 2025-12-09T12:46:57.403900Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3545s 2025-12-09T12:46:57.404821Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:57.527474Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15edfa303b-3f7b-4ef0-b063-f1f7b7e1757c 2025-12-09T12:46:57.527755Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4783s 2025-12-09T12:46:57.528370Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming/From_primary-0 (31.34s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming/From_primary-0 (31.34s) === RUN TestTrustDomainAliasSecureNaming 2025-12-09T12:46:26.393687Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming]' === 2025-12-09T12:46:57.752257Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming] (31.358564906s)' === 2025-12-09T12:46:57.752364Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:46:57.752378Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:46:57.752373Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:46:57.953908Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15de9a6f9f-dfd5-4362-97da-a4ad2b1c2cc8 2025-12-09T12:46:57.954177Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2016s 2025-12-09T12:46:57.955038Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:58.082507Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/152a154519-279c-4168-8d50-0cca971ea815 2025-12-09T12:46:58.082603Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3300s 2025-12-09T12:46:58.083604Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:58.229323Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15fb0a2d98-6ebb-446b-8bb9-0e0b1bb7ace3 2025-12-09T12:46:58.229499Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4769s 2025-12-09T12:46:58.230489Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming (32.12s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming (32.12s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/client[plaintext]->server:http-plaintext[allow] (0.03s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/client[plaintext]->server:tcp-plaintext[allow] (0.03s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[plaintext]->server:http-plaintext[allow] (1.01s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[plaintext]->server:tcp-plaintext[allow] (0.01s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/client[cluster.local]->server:http-mtls[allow] (0.03s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/client[cluster.local]->server:tcp-mtls[allow] (0.02s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[bar]->server:http-mtls[deny] (0.04s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[bar]->server:tcp-mtls[deny] (0.04s) PASS tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[bar]->server:tcp-mtls-pass-through[deny] (0.03s) === RUN TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] 2025-12-09T12:46:59.793728Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'https://server:8091': call failed from naked (cluster=cluster-0) to https://server:8091 (using https): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "https://server:8091": remote error: tls: unknown certificate authority 2025-12-09T12:47:29.795142Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]] (30.001404344s)' === 2025-12-09T12:47:29.795288Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:47:29.795291Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:47:29.795306Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:47:29.975207Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16fcb4e175-60c4-4c67-8ff7-66136dcf7ecf 2025-12-09T12:47:29.975431Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1797s 2025-12-09T12:47:29.976215Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:47:30.072236Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/164caf5929-2110-4eba-8f79-ca0d0c2a76a6 2025-12-09T12:47:30.072306Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2765s 2025-12-09T12:47:30.072995Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:47:30.179811Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1616d76296-3df3-4923-a875-985bdcb966a8 2025-12-09T12:47:30.179886Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3841s 2025-12-09T12:47:30.180592Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (30.59s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (30.59s) === RUN TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow] 2025-12-09T12:47:30.381805Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://server:8093': call failed from naked (cluster=cluster-0) to tcp://server:8093 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:48:00.382168Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]] (30.000355835s)' === 2025-12-09T12:48:00.382267Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]... 2025-12-09T12:48:00.382266Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]... 2025-12-09T12:48:00.382337Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]... 2025-12-09T12:48:00.539393Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16a3a45d1c-3905-47b4-92ba-9c75d46658a5 2025-12-09T12:48:00.539633Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1571s 2025-12-09T12:48:00.540436Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:00.621531Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16d7336fa3-20a9-4895-a615-3e07fa8f5979 2025-12-09T12:48:00.621657Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2391s 2025-12-09T12:48:00.622453Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:00.704059Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1655d41741-6f0e-430b-9ef9-084d909f1f22 2025-12-09T12:48:00.704175Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3216s 2025-12-09T12:48:00.705175Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow] (30.60s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow] (30.60s) === RUN TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] 2025-12-09T12:48:00.981942Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://172.21.3.249:9000': call failed from naked (cluster=cluster-0) to tcp://172.21.3.249:9000 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:48:30.983059Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]] (30.001113177s)' === 2025-12-09T12:48:30.983168Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:48:30.983186Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:48:30.983167Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:48:31.160091Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16f1c9b2b2-9285-4a39-b5cb-c5900585ccb9 2025-12-09T12:48:31.160257Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1768s 2025-12-09T12:48:31.161170Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:31.258795Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1691c8bc87-3ace-4857-abd6-5266af36f924 2025-12-09T12:48:31.259047Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2756s 2025-12-09T12:48:31.259807Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:31.350380Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1604c5fa70-a72b-4cc2-8c0f-a696375ddcc8 2025-12-09T12:48:31.350507Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3670s 2025-12-09T12:48:31.351503Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (30.78s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (30.78s) === RUN TestTrustDomainValidation/From_primary-0 2025-12-09T12:46:58.532336Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:48:31.764328Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (1m33.231982591s)' === 2025-12-09T12:48:31.764440Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:48:31.764449Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:48:31.764471Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:48:31.944498Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1616f9523b-3642-45e3-8a12-90fd2920c462 2025-12-09T12:48:31.944758Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1801s 2025-12-09T12:48:31.945429Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.044611Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/165d27b154-557c-4e58-bec5-301d95299778 2025-12-09T12:48:32.044754Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2801s 2025-12-09T12:48:32.045674Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.149804Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16a4eae9ee-fad3-4864-a805-8203f2090f13 2025-12-09T12:48:32.149942Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3853s 2025-12-09T12:48:32.151012Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0 (94.02s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0 (94.02s) === RUN TestTrustDomainValidation 2025-12-09T12:46:58.511312Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:48:32.555276Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (1m34.043957833s)' === 2025-12-09T12:48:32.555386Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:48:32.555387Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:48:32.555398Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:48:32.713472Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/162dd1b88f-c16f-404a-9a6f-1354e4c83d22 2025-12-09T12:48:32.713679Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1580s 2025-12-09T12:48:32.714800Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.817168Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16bb2ae4b1-f984-46ba-bf23-aef22edd0581 2025-12-09T12:48:32.817497Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2619s 2025-12-09T12:48:32.818118Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.904475Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16909d55a1-2bc4-48f2-b2c7-58369c2c47ed 2025-12-09T12:48:32.904599Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3490s 2025-12-09T12:48:32.905353Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation (94.83s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation (94.83s) 2025-12-09T12:48:33.345154Z info tf === FAILED: Test Run: 'security_ca_custom_root' (exitCode: 1) === 2025-12-09T12:48:33.345242Z info tf === Suite "security_ca_custom_root" run time: 2m32.760957054s === 2025-12-09T12:48:33.345264Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/trace.yaml 2025-12-09T12:48:33.346528Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:33.346553Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:33.346553Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:33.534779Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:48:33Z/17b1e5deb6-cff6-4f0d-9ff1-1d17bd71e49b 2025-12-09T12:48:33.535028Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1881s 2025-12-09T12:48:33.535818Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:33.657186Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:48:33Z/171f981b3f-5b23-46bb-9535-c3d6d531d9c4 2025-12-09T12:48:33.657406Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3104s 2025-12-09T12:48:33.658131Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:33.760820Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:48:33Z/17020b9a52-73f0-4ca4-bc89-aad5a7954171 2025-12-09T12:48:33.760909Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4139s 2025-12-09T12:48:33.761612Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:34.101290Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:48:34.101387Z info tf === SUCCEEDED: Cleanup Istio in 92.082µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root DONE 22 tests, 9 failures in 167.277s exec: [go test -json -test.run=^TestSecureNaming$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 328526 2025-12-09T12:48:47.199582Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:48:47.199655Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:48:47.239628Z info tf === Test Framework Settings === 2025-12-09T12:48:47.239700Z info tf TestID: security_ca_custom_root RunID: a0358b31-b899-4131-afcb-e426c96efc3b NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:48:47.239711Z info tf =============================== 2025-12-09T12:48:47.239935Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3 2025-12-09T12:48:47.240026Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:48:47.240038Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:48:47.240054Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:48:47.240064Z info tf === BEGIN: Building clusters === 2025-12-09T12:48:47.243352Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:48:47.243361Z info tf === DONE: Building clusters === 2025-12-09T12:48:47.243374Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:48:47.290540Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:48:47.290596Z info tf === SUCCESS: context setup function === 2025-12-09T12:48:47.290604Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:48:47.290611Z info tf === Istio Component Config === 2025-12-09T12:48:47.290661Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:48:47.290668Z info tf ================================ 2025-12-09T12:48:47.293620Z info tf skipping deployment as specified in the config 2025-12-09T12:48:47.293636Z info tf === SUCCEEDED: Deploy Istio in 3.028841ms [Suite=security_ca_custom_root]=== 2025-12-09T12:48:47.293642Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:48:47.370185Z info tf === SUCCEEDED: Create namespace echo1 in 76.536844ms === Generating RSA private key, 2048 bit long modulus (2 primes) ******************************************************************************************+++++ ****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3/_suite_context/ca-custom-root-208808375/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *******************************************************************************************************************************************+++++ ************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3/_suite_context/ca-custom-root-208808375/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) **********************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ ***************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3/_suite_context/ca-custom-root-208808375/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:48:49.188046Z info tf === BEGIN: Create namespace external === 2025-12-09T12:48:49.221242Z info tf === SUCCEEDED: Create namespace external in 33.191516ms === 2025-12-09T12:48:49.443182Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:48:49.505712Z error tf === FAILED: Deploy echo instances === 2025-12-09T12:48:49.505756Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3/_suite_context/ServiceAccount-Service.719581220.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "naked" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:48:49.505802Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:49.505815Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:49.505836Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:49.670387Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3/_suite_context/ServiceAccount-Service.719581220.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "naked" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:48:49.670451Z info tf === FAILED: Setup: 'security_ca_custom_root' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3/_suite_context/ServiceAccount-Service.719581220.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "naked" is forbidden: unable to create new content in namespace echo1 because it is being terminated) === 2025-12-09T12:48:49.670460Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-a0358b3/_suite_context/ServiceAccount-Service.719581220.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "naked" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:48:49.670483Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:49.670493Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:49.670509Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:48:49.826022Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:48:49Z/24161a7f17-e7f9-455f-a378-f91c8fb6ba57 2025-12-09T12:48:49.826181Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3199s 2025-12-09T12:48:49.826916Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:49.913761Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:48:49.913841Z info tf === SUCCEEDED: Cleanup Istio in 75.384µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainAliasSecureNaming$/^From_primary-0/server:server-naked-foo\[success\]$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 330070 2025-12-09T12:49:03.561403Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:49:03.561462Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:49:03.594302Z info tf === Test Framework Settings === 2025-12-09T12:49:03.594368Z info tf TestID: security_ca_custom_root RunID: e64ca5cd-88f0-4a2c-a7d1-106b8f3ca89e NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:49:03.594375Z info tf =============================== 2025-12-09T12:49:03.594532Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e64ca5c 2025-12-09T12:49:03.594610Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:49:03.594620Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:49:03.594635Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:49:03.594643Z info tf === BEGIN: Building clusters === 2025-12-09T12:49:03.597575Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:49:03.597584Z info tf === DONE: Building clusters === 2025-12-09T12:49:03.597598Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:49:03.637886Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:49:03.637934Z info tf === SUCCESS: context setup function === 2025-12-09T12:49:03.637942Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:49:03.637949Z info tf === Istio Component Config === 2025-12-09T12:49:03.637999Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:49:03.638011Z info tf ================================ 2025-12-09T12:49:03.640748Z info tf skipping deployment as specified in the config 2025-12-09T12:49:03.640766Z info tf === SUCCEEDED: Deploy Istio in 2.819179ms [Suite=security_ca_custom_root]=== 2025-12-09T12:49:03.640773Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:49:03.719498Z info tf === SUCCEEDED: Create namespace echo1 in 78.715409ms === Generating RSA private key, 2048 bit long modulus (2 primes) *************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ ***************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e64ca5c/_suite_context/ca-custom-root-157923728/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *********************************************************************************************************************************************************************************************+++++ *************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e64ca5c/_suite_context/ca-custom-root-157923728/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *************************************************************************************************************************************************************************************************************************+++++ ******************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e64ca5c/_suite_context/ca-custom-root-157923728/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:49:05.028147Z info tf === BEGIN: Create namespace external === 2025-12-09T12:49:05.052993Z info tf === SUCCEEDED: Create namespace external in 24.855948ms === 2025-12-09T12:49:05.161370Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:49:06.491281Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.493087Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.493126Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.495606Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.500032Z info sync complete name=pod controller attempt=3 time=6.876226ms 2025-12-09T12:49:06.510718Z info sync complete name=pod controller attempt=4 time=15.062562ms 2025-12-09T12:49:06.532532Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.539030Z info sync complete name=pod controller attempt=3 time=6.458183ms 2025-12-09T12:49:06.549430Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.557520Z info sync complete name=pod controller attempt=6 time=64.333003ms 2025-12-09T12:49:06.562808Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.570750Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.570816Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.570923Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.570962Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.570997Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.578040Z info sync complete name=pod controller attempt=4 time=15.190035ms 2025-12-09T12:49:06.580819Z info sync complete name=pod controller attempt=5 time=31.337115ms 2025-12-09T12:49:06.585869Z info sync complete name=pod controller attempt=4 time=14.867412ms 2025-12-09T12:49:06.585882Z info sync complete name=pod controller attempt=4 time=15.068863ms 2025-12-09T12:49:06.585919Z info sync complete name=pod controller attempt=4 time=15.069112ms 2025-12-09T12:49:06.585913Z info sync complete name=pod controller attempt=4 time=14.857149ms 2025-12-09T12:49:06.585900Z info sync complete name=pod controller attempt=4 time=14.917787ms 2025-12-09T12:49:06.591437Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.591745Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.594153Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.594274Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.596645Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.619934Z info sync complete name=pod controller attempt=7 time=128.608196ms 2025-12-09T12:49:06.623545Z info sync complete name=pod controller attempt=5 time=32.081387ms 2025-12-09T12:49:06.630004Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:49:06.632818Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.637650Z info sync complete name=pod controller attempt=3 time=7.612377ms 2025-12-09T12:49:06.650587Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.663283Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.671274Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.671316Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.671361Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.671399Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.671501Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.692062Z info klog Caches are synced controller=echo 2025-12-09T12:49:06.731125Z info klog Caches are synced controller=echo 2025-12-09T12:49:17.778076Z info tf === SUCCEEDED: Deploy echo instances in 12.616690515s === 2025-12-09T12:49:17.809958Z info tf === DONE: Setup: 'security_ca_custom_root' (14.212344525s) === 2025-12-09T12:49:17.810021Z info tf === BEGIN: Test Run: 'security_ca_custom_root' === === RUN TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] 2025-12-09T12:49:17.835192Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]]' === test.go:322: failed calling client (cluster=cluster-0)->'http://server-naked-foo:443': call failed from client (cluster=cluster-0) to http://server-naked-foo:443 (using http): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "http://server-naked-foo:443": read tcp 172.23.1.141:35440->172.30.44.111:443: read: connection reset by peer 2025-12-09T12:49:47.841709Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]] (30.006514734s)' === 2025-12-09T12:49:47.841764Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:49:47.841769Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:49:47.841797Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:49:48.029306Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/348e2ae965-8337-4b44-b489-bb58b2c2b6ff 2025-12-09T12:49:48.029604Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1875s 2025-12-09T12:49:48.030247Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.139053Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34cdaf80e6-967d-450d-a7a5-425891357caf 2025-12-09T12:49:48.139197Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2970s 2025-12-09T12:49:48.139987Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.222149Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34eecff9e3-dd23-4e15-86ec-5e7e9559b512 2025-12-09T12:49:48.222245Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3801s 2025-12-09T12:49:48.222881Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (30.58s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (re-run 1) (30.58s) === RUN TestTrustDomainAliasSecureNaming/From_primary-0 2025-12-09T12:49:17.834839Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0]' === 2025-12-09T12:49:48.412695Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0] (30.577853325s)' === 2025-12-09T12:49:48.412776Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:49:48.412797Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:49:48.412787Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:49:48.592443Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34066dfd21-aff9-4059-a5f8-f6e73b0e6ff1 2025-12-09T12:49:48.592836Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1798s 2025-12-09T12:49:48.593480Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.696101Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34fe2d9a95-3f1e-4f9d-83e8-1bd0124019b3 2025-12-09T12:49:48.696263Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2832s 2025-12-09T12:49:48.697151Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.807581Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34779e66c3-818f-446a-aa69-cea8121ebb27 2025-12-09T12:49:48.807716Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3947s 2025-12-09T12:49:48.808722Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming/From_primary-0 (31.17s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming/From_primary-0 (re-run 1) (31.17s) === RUN TestTrustDomainAliasSecureNaming 2025-12-09T12:49:17.810487Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming]' === 2025-12-09T12:49:49.009111Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming] (31.198616223s)' === 2025-12-09T12:49:49.009213Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:49:49.009251Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:49:49.009234Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:49:49.156188Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34d4bd6dc3-230c-4178-8127-347089710ff2 2025-12-09T12:49:49.156480Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1469s 2025-12-09T12:49:49.157035Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:49.247743Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/345bbd0e8d-d340-4d8b-a24b-74b276165c35 2025-12-09T12:49:49.247880Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2384s 2025-12-09T12:49:49.248619Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:49.327840Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/344ae7d806-d0aa-4b08-9308-6b640c177546 2025-12-09T12:49:49.327950Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3184s 2025-12-09T12:49:49.328608Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming (31.70s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming (re-run 1) (31.70s) 2025-12-09T12:49:49.510384Z info tf === FAILED: Test Run: 'security_ca_custom_root' (exitCode: 1) === 2025-12-09T12:49:49.510457Z info tf === Suite "security_ca_custom_root" run time: 45.912856935s === 2025-12-09T12:49:49.510480Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/trace.yaml 2025-12-09T12:49:49.511005Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:49:49.511007Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:49:49.511035Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:49:49.723747Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:49Z/35bae7c6ff-48c6-4b2a-a0b4-d29b18513c45 2025-12-09T12:49:49.723952Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2127s 2025-12-09T12:49:49.724771Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:49.866991Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:49Z/35ffc1e1b7-e00a-492b-8cb7-581a4fc8c103 2025-12-09T12:49:49.867120Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3559s 2025-12-09T12:49:49.868001Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:49.954976Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:49Z/35d3cca4aa-f4ac-4cee-805e-c7d935cdfab3 2025-12-09T12:49:49.955099Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4439s 2025-12-09T12:49:49.956000Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:50.622057Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:49:50.622192Z info tf === SUCCEEDED: Cleanup Istio in 126.688µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainAliasSecureNaming$/^From_primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 331679 2025-12-09T12:50:02.651704Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:50:02.651753Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:50:02.682377Z info tf === Test Framework Settings === 2025-12-09T12:50:02.682458Z info tf TestID: security_ca_custom_root RunID: f1bcad73-7986-4dc7-83c0-689d8481fb09 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:50:02.682465Z info tf =============================== 2025-12-09T12:50:02.682651Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7 2025-12-09T12:50:02.682796Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:50:02.682813Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:50:02.682840Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:50:02.682853Z info tf === BEGIN: Building clusters === 2025-12-09T12:50:02.686395Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:50:02.686404Z info tf === DONE: Building clusters === 2025-12-09T12:50:02.686423Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:50:02.759231Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:50:02.759274Z info tf === SUCCESS: context setup function === 2025-12-09T12:50:02.759283Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:50:02.759293Z info tf === Istio Component Config === 2025-12-09T12:50:02.759357Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:50:02.759366Z info tf ================================ 2025-12-09T12:50:02.762368Z info tf skipping deployment as specified in the config 2025-12-09T12:50:02.762389Z info tf === SUCCEEDED: Deploy Istio in 3.101061ms [Suite=security_ca_custom_root]=== 2025-12-09T12:50:02.762398Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:50:02.811213Z info tf === SUCCEEDED: Create namespace echo1 in 48.806465ms === Generating RSA private key, 2048 bit long modulus (2 primes) **********+++++ *******************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7/_suite_context/ca-custom-root-1266436176/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) **************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ *********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7/_suite_context/ca-custom-root-1266436176/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *********************************************************************************************************+++++ *************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7/_suite_context/ca-custom-root-1266436176/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:50:04.475136Z info tf === BEGIN: Create namespace external === 2025-12-09T12:50:04.484533Z info tf === SUCCEEDED: Create namespace external in 9.406375ms === 2025-12-09T12:50:04.559944Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:50:04.590555Z error tf === FAILED: Deploy echo instances === 2025-12-09T12:50:04.590606Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7/_suite_context/Service.619285723.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-12-09T12:50:04.590641Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:50:04.590653Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:50:04.590683Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:50:04.627468Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7/_suite_context/Service.619285723.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-12-09T12:50:04.627552Z info tf === FAILED: Setup: 'security_ca_custom_root' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7/_suite_context/Service.619285723.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-12-09T12:50:04.627564Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-f1bcad7/_suite_context/Service.619285723.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-12-09T12:50:04.627611Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:50:04.627614Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:50:04.627643Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:50:04.663828Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:50:04.663904Z info tf === SUCCEEDED: Cleanup Istio in 71.362µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0/naked\[foo\]->server:http-mtls\[allow\]$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 333103 2025-12-09T12:50:15.693965Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:50:15.694021Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:50:15.726513Z info tf === Test Framework Settings === 2025-12-09T12:50:15.726590Z info tf TestID: security_ca_custom_root RunID: 352c0d20-9dea-4c80-ac7e-ddc50c4e22df NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:50:15.726596Z info tf =============================== 2025-12-09T12:50:15.726754Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-352c0d2 2025-12-09T12:50:15.726842Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:50:15.726858Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:50:15.726877Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:50:15.726885Z info tf === BEGIN: Building clusters === 2025-12-09T12:50:15.729986Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:50:15.729994Z info tf === DONE: Building clusters === 2025-12-09T12:50:15.730008Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:50:15.787665Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:50:15.787737Z info tf === SUCCESS: context setup function === 2025-12-09T12:50:15.787749Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:50:15.787761Z info tf === Istio Component Config === 2025-12-09T12:50:15.787813Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:50:15.787819Z info tf ================================ 2025-12-09T12:50:15.790945Z info tf skipping deployment as specified in the config 2025-12-09T12:50:15.790964Z info tf === SUCCEEDED: Deploy Istio in 3.208953ms [Suite=security_ca_custom_root]=== 2025-12-09T12:50:15.790972Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:50:15.872627Z info tf === SUCCEEDED: Create namespace echo1 in 81.631796ms === Generating RSA private key, 2048 bit long modulus (2 primes) ***********************************+++++ ***************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-352c0d2/_suite_context/ca-custom-root-119533658/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ***************+++++ **************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-352c0d2/_suite_context/ca-custom-root-119533658/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) **********************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ ***********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-352c0d2/_suite_context/ca-custom-root-119533658/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:50:17.348653Z info tf === BEGIN: Create namespace external === 2025-12-09T12:50:17.368365Z info tf === SUCCEEDED: Create namespace external in 19.720865ms === 2025-12-09T12:50:17.532260Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:50:18.778686Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.785861Z info sync complete name=pod controller attempt=3 time=7.081897ms 2025-12-09T12:50:18.803021Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.805196Z info sync complete name=pod controller attempt=2 time=2.079053ms 2025-12-09T12:50:18.827423Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.831611Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.833588Z info sync complete name=pod controller attempt=3 time=6.113147ms 2025-12-09T12:50:18.838311Z info sync complete name=pod controller attempt=3 time=6.595175ms 2025-12-09T12:50:18.849121Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.849905Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.849944Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.856922Z info sync complete name=pod controller attempt=3 time=6.978606ms 2025-12-09T12:50:18.856939Z info sync complete name=pod controller attempt=3 time=7.769618ms 2025-12-09T12:50:18.857008Z info sync complete name=pod controller attempt=3 time=7.004443ms 2025-12-09T12:50:18.879836Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.891626Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.895656Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.897544Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.902269Z info sync complete name=pod controller attempt=3 time=6.587729ms 2025-12-09T12:50:18.903161Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.903808Z info sync complete name=pod controller attempt=3 time=6.231302ms 2025-12-09T12:50:18.906930Z info sync complete name=pod controller attempt=4 time=15.267572ms 2025-12-09T12:50:18.910470Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.927720Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.932177Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.936338Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.942112Z info sync complete name=pod controller attempt=5 time=31.609065ms 2025-12-09T12:50:18.948770Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.949234Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.950627Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.950673Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.951021Z info sync complete name=pod controller attempt=4 time=14.598532ms 2025-12-09T12:50:18.951028Z info sync complete name=pod controller attempt=2 time=2.190366ms 2025-12-09T12:50:18.975469Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:50:18.982141Z info sync complete name=pod controller attempt=3 time=6.565368ms 2025-12-09T12:50:18.992639Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.995818Z info klog Caches are synced controller=echo 2025-12-09T12:50:18.998246Z info klog Caches are synced controller=echo 2025-12-09T12:50:19.011258Z info klog Caches are synced controller=echo 2025-12-09T12:50:19.036946Z info klog Caches are synced controller=echo 2025-12-09T12:50:19.049117Z info klog Caches are synced controller=echo 2025-12-09T12:50:19.076794Z info klog Caches are synced controller=echo 2025-12-09T12:50:28.583493Z info tf === SUCCEEDED: Deploy echo instances in 11.051217068s === 2025-12-09T12:50:28.611357Z info tf === DONE: Setup: 'security_ca_custom_root' (12.881327628s) === 2025-12-09T12:50:28.611441Z info tf === BEGIN: Test Run: 'security_ca_custom_root' === === RUN TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] 2025-12-09T12:50:28.640639Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'https://server:8091': call failed from naked (cluster=cluster-0) to https://server:8091 (using https): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "https://server:8091": remote error: tls: unknown certificate authority 2025-12-09T12:50:58.641155Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]] (30.000506135s)' === 2025-12-09T12:50:58.641271Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:50:58.641286Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:50:58.641271Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:50:58.781452Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49ef4e1db9-6d29-4e8b-99b4-aec5d19a0f66 2025-12-09T12:50:58.781740Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1399s 2025-12-09T12:50:58.782501Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:58.865108Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/499467c12d-a573-4df9-ac08-08b65000e6ec 2025-12-09T12:50:58.865258Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2234s 2025-12-09T12:50:58.866221Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:58.952328Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/4931c7fe17-a7f7-4238-be76-2f5cbf48ff41 2025-12-09T12:50:58.952477Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3106s 2025-12-09T12:50:58.953491Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (30.46s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (re-run 1) (30.46s) === RUN TestTrustDomainValidation/From_primary-0 2025-12-09T12:50:28.639746Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:50:59.099864Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.460109417s)' === 2025-12-09T12:50:59.099972Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:50:59.099974Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:50:59.099974Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:50:59.227416Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/496dc0aace-a3a9-4b53-980c-73fb6e71c107 2025-12-09T12:50:59.227671Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1275s 2025-12-09T12:50:59.228298Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.327525Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/490b54c87c-72e1-4c80-a6db-109a962ebe5e 2025-12-09T12:50:59.327679Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2275s 2025-12-09T12:50:59.328604Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.414667Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49064af7b8-a364-4a59-a30a-81445225395d 2025-12-09T12:50:59.414852Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3146s 2025-12-09T12:50:59.415620Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0 (30.93s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0 (re-run 1) (30.93s) === RUN TestTrustDomainValidation 2025-12-09T12:50:28.612169Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:50:59.567090Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (30.954905483s)' === 2025-12-09T12:50:59.567253Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:50:59.567251Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:50:59.567280Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:50:59.720539Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/4923f3d04a-7b5b-4322-a5b5-19d8ec18e583 2025-12-09T12:50:59.720699Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1532s 2025-12-09T12:50:59.721616Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.815862Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49b83c7b5b-a2a6-4152-ad36-1642f44fa803 2025-12-09T12:50:59.816100Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2486s 2025-12-09T12:50:59.816843Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.903731Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49328e356f-e544-48cb-9249-a9c79cf5b22f 2025-12-09T12:50:59.903872Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3363s 2025-12-09T12:50:59.904620Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation (31.44s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation (re-run 1) (31.44s) 2025-12-09T12:51:00.055661Z info tf === FAILED: Test Run: 'security_ca_custom_root' (exitCode: 1) === 2025-12-09T12:51:00.055759Z info tf === Suite "security_ca_custom_root" run time: 44.32574561s === 2025-12-09T12:51:00.055789Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/trace.yaml 2025-12-09T12:51:00.056210Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:00.056218Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:00.056236Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:00.304085Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:00Z/5053b8e3ef-bcff-47c3-a759-a8781f3dfd08 2025-12-09T12:51:00.304422Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2479s 2025-12-09T12:51:00.304973Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:51:00.395461Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:00Z/50538d9850-7769-48eb-ac3b-06ec2f2a973a 2025-12-09T12:51:00.395585Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3390s 2025-12-09T12:51:00.396403Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:51:00.474174Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:00Z/508a5875aa-df8f-47a9-9f7e-526c3607ba1f 2025-12-09T12:51:00.474293Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4177s 2025-12-09T12:51:00.475326Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:51:00.608961Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:51:00.609081Z info tf === SUCCEEDED: Cleanup Istio in 103.187µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0/naked\[foo\]->server:tcp-mtls\[allow\]$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 334660 2025-12-09T12:51:11.528063Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:51:11.528136Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:51:11.562321Z info tf === Test Framework Settings === 2025-12-09T12:51:11.562389Z info tf TestID: security_ca_custom_root RunID: e6aaeb1f-91f0-476e-815a-ff7deb8f825c NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:51:11.562397Z info tf =============================== 2025-12-09T12:51:11.562537Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1 2025-12-09T12:51:11.562613Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:51:11.562622Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:51:11.562640Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:51:11.562647Z info tf === BEGIN: Building clusters === 2025-12-09T12:51:11.565709Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:51:11.565716Z info tf === DONE: Building clusters === 2025-12-09T12:51:11.565732Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:51:11.669175Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:51:11.669239Z info tf === SUCCESS: context setup function === 2025-12-09T12:51:11.669250Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:51:11.669261Z info tf === Istio Component Config === 2025-12-09T12:51:11.669337Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:51:11.669348Z info tf ================================ 2025-12-09T12:51:11.674085Z info tf skipping deployment as specified in the config 2025-12-09T12:51:11.674111Z info tf === SUCCEEDED: Deploy Istio in 4.853869ms [Suite=security_ca_custom_root]=== 2025-12-09T12:51:11.674121Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:51:11.689505Z info tf === SUCCEEDED: Create namespace echo1 in 15.365777ms === Generating RSA private key, 2048 bit long modulus (2 primes) *************************************************************************************************************+++++ ***************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1/_suite_context/ca-custom-root-2593928610/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) **************************************************************************************************************+++++ ****************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1/_suite_context/ca-custom-root-2593928610/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ **********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1/_suite_context/ca-custom-root-2593928610/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:51:13.242700Z info tf === BEGIN: Create namespace external === 2025-12-09T12:51:13.252371Z info tf === SUCCEEDED: Create namespace external in 9.689186ms === 2025-12-09T12:51:13.379960Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:51:13.403166Z error tf === FAILED: Deploy echo instances === 2025-12-09T12:51:13.403213Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1/_suite_context/ServiceAccount-Service.1879703847.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:51:13.403255Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:13.403260Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:13.403303Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:13.436139Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1/_suite_context/ServiceAccount-Service.1879703847.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:51:13.436204Z info tf === FAILED: Setup: 'security_ca_custom_root' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1/_suite_context/ServiceAccount-Service.1879703847.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated) === 2025-12-09T12:51:13.436212Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-e6aaeb1/_suite_context/ServiceAccount-Service.1879703847.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:51:13.436237Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:13.436263Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:13.436259Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:51:13.629508Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:51:13.629596Z info tf === SUCCEEDED: Cleanup Istio in 78.589µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0/naked\[foo\]->server:tcp-mtls-pass-through\[allow\]$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 336051 2025-12-09T12:51:26.550668Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:51:26.550725Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:51:26.583327Z info tf === Test Framework Settings === 2025-12-09T12:51:26.583421Z info tf TestID: security_ca_custom_root RunID: ef4ef59f-fe61-407b-be04-a674bc1bb597 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:51:26.583429Z info tf =============================== 2025-12-09T12:51:26.583615Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-ef4ef59 2025-12-09T12:51:26.583707Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:51:26.583720Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:51:26.583741Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:51:26.583750Z info tf === BEGIN: Building clusters === 2025-12-09T12:51:26.586859Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:51:26.586868Z info tf === DONE: Building clusters === 2025-12-09T12:51:26.586890Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:51:26.621319Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:51:26.621378Z info tf === SUCCESS: context setup function === 2025-12-09T12:51:26.621386Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:51:26.621397Z info tf === Istio Component Config === 2025-12-09T12:51:26.621458Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:51:26.621465Z info tf ================================ 2025-12-09T12:51:26.624360Z info tf skipping deployment as specified in the config 2025-12-09T12:51:26.624378Z info tf === SUCCEEDED: Deploy Istio in 2.986251ms [Suite=security_ca_custom_root]=== 2025-12-09T12:51:26.624385Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:51:26.640049Z info tf === SUCCEEDED: Create namespace echo1 in 15.647442ms === Generating RSA private key, 2048 bit long modulus (2 primes) *************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ **********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-ef4ef59/_suite_context/ca-custom-root-2987498751/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ **********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-ef4ef59/_suite_context/ca-custom-root-2987498751/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ******************************************************+++++ ************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-ef4ef59/_suite_context/ca-custom-root-2987498751/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:51:29.775494Z info tf === BEGIN: Create namespace external === 2025-12-09T12:51:29.791582Z info tf === SUCCEEDED: Create namespace external in 16.111925ms === 2025-12-09T12:51:29.888924Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:51:31.029222Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.061268Z info sync complete name=pod controller attempt=5 time=31.929874ms 2025-12-09T12:51:31.080891Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.088183Z info sync complete name=pod controller attempt=3 time=7.206375ms 2025-12-09T12:51:31.112012Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.118517Z info sync complete name=pod controller attempt=3 time=6.419391ms 2025-12-09T12:51:31.120166Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.120955Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.123071Z info sync complete name=pod controller attempt=2 time=2.080874ms 2025-12-09T12:51:31.126786Z info sync complete name=pod controller attempt=3 time=6.574474ms 2025-12-09T12:51:31.129435Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.138309Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.146284Z info sync complete name=pod controller attempt=3 time=7.836459ms 2025-12-09T12:51:31.148191Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.148227Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.154969Z info sync complete name=pod controller attempt=3 time=6.672066ms 2025-12-09T12:51:31.154969Z info sync complete name=pod controller attempt=3 time=6.714382ms 2025-12-09T12:51:31.162361Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.169260Z info sync complete name=pod controller attempt=3 time=6.85207ms 2025-12-09T12:51:31.181944Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.187409Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.187408Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.188110Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.188186Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.188255Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:51:31.194705Z info sync complete name=pod controller attempt=3 time=6.45254ms 2025-12-09T12:51:31.194807Z info sync complete name=pod controller attempt=3 time=6.516951ms 2025-12-09T12:51:31.194822Z info sync complete name=pod controller attempt=3 time=6.660783ms 2025-12-09T12:51:31.202657Z info sync complete name=pod controller attempt=4 time=15.189911ms 2025-12-09T12:51:31.202604Z info sync complete name=pod controller attempt=4 time=15.133828ms 2025-12-09T12:51:31.212249Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.220948Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.221062Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.239675Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.248771Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.248796Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.263347Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.288248Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.288303Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.288295Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.288328Z info klog Caches are synced controller=echo 2025-12-09T12:51:31.288244Z info klog Caches are synced controller=echo 2025-12-09T12:51:40.793848Z info tf === SUCCEEDED: Deploy echo instances in 10.904900752s === 2025-12-09T12:51:40.825760Z info tf === DONE: Setup: 'security_ca_custom_root' (14.238845308s) === 2025-12-09T12:51:40.825858Z info tf === BEGIN: Test Run: 'security_ca_custom_root' === === RUN TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] 2025-12-09T12:51:40.849625Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://172.20.3.18:9000': call failed from naked (cluster=cluster-0) to tcp://172.20.3.18:9000 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:52:10.850866Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]] (30.001232692s)' === 2025-12-09T12:52:10.851019Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:52:10.851019Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:52:10.851031Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:52:11.001285Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67673f04dc-21d6-481a-a78a-3706250d6ced 2025-12-09T12:52:11.001670Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1503s 2025-12-09T12:52:11.002323Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.084714Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/6717ede230-8c15-4941-996f-f969eab6877a 2025-12-09T12:52:11.084831Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2334s 2025-12-09T12:52:11.085601Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.199742Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67caa8da30-8f5a-4501-92ba-15f0d121d449 2025-12-09T12:52:11.200017Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3486s 2025-12-09T12:52:11.201275Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (30.55s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (re-run 1) (30.55s) === RUN TestTrustDomainValidation/From_primary-0 2025-12-09T12:51:40.848732Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:52:11.404402Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.555664116s)' === 2025-12-09T12:52:11.404506Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:52:11.404531Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:52:11.404524Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:52:11.625506Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67aaaff51a-cb21-4199-b7d0-eb807e1d2dd4 2025-12-09T12:52:11.625687Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2209s 2025-12-09T12:52:11.626564Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.727097Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/672b5e86ad-0e39-40cd-a1b1-1e2edfef3469 2025-12-09T12:52:11.727353Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3226s 2025-12-09T12:52:11.727992Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.825006Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/6702311452-cf13-4a41-b3fa-15f08171e054 2025-12-09T12:52:11.825116Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4203s 2025-12-09T12:52:11.825878Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0 (31.11s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0 (re-run 1) (31.11s) === RUN TestTrustDomainValidation 2025-12-09T12:51:40.826564Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:52:11.954970Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (31.128395948s)' === 2025-12-09T12:52:11.955104Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:52:11.955105Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:52:11.955128Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:52:12.106008Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67b160d42f-b4ee-4aec-9019-4de4f41da06b 2025-12-09T12:52:12.106439Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1512s 2025-12-09T12:52:12.107148Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:12.196574Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67f812a6d1-1f30-490f-9cf2-25cf12b9e418 2025-12-09T12:52:12.196675Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2414s 2025-12-09T12:52:12.199088Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:12.286158Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67d882ea73-8c46-43fb-91b5-cb2d8b6ce59f 2025-12-09T12:52:12.286283Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3310s 2025-12-09T12:52:12.287328Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation (31.67s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation (re-run 1) (31.67s) 2025-12-09T12:52:12.494853Z info tf === FAILED: Test Run: 'security_ca_custom_root' (exitCode: 1) === 2025-12-09T12:52:12.495024Z info tf === Suite "security_ca_custom_root" run time: 45.908136087s === 2025-12-09T12:52:12.495044Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/trace.yaml 2025-12-09T12:52:12.495347Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:12.495349Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:12.495362Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:12.663909Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:12Z/687cf5d145-31ea-40a6-97d9-dd52b17b4bc3 2025-12-09T12:52:12.664134Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1684s 2025-12-09T12:52:12.664885Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:12.760266Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:12Z/682b8791bb-4d6b-403d-8f92-cb916409f831 2025-12-09T12:52:12.760402Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2647s 2025-12-09T12:52:12.761406Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:12.846038Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:12Z/68a8bea488-4c87-4d43-bedf-1a2af5f38f87 2025-12-09T12:52:12.846168Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3505s 2025-12-09T12:52:12.846864Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:13.047062Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:52:13.047169Z info tf === SUCCEEDED: Cleanup Istio in 98.636µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 337618 2025-12-09T12:52:26.164246Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:52:26.164334Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:52:26.214930Z info tf === Test Framework Settings === 2025-12-09T12:52:26.215044Z info tf TestID: security_ca_custom_root RunID: 17d00686-51fd-40c8-ac1e-3b6054202a58 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:52:26.215052Z info tf =============================== 2025-12-09T12:52:26.215308Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068 2025-12-09T12:52:26.215430Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:52:26.215450Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:52:26.215473Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:52:26.215485Z info tf === BEGIN: Building clusters === 2025-12-09T12:52:26.219908Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:52:26.219917Z info tf === DONE: Building clusters === 2025-12-09T12:52:26.219950Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:52:26.253592Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:52:26.253653Z info tf === SUCCESS: context setup function === 2025-12-09T12:52:26.253663Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:52:26.253674Z info tf === Istio Component Config === 2025-12-09T12:52:26.253740Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:52:26.253749Z info tf ================================ 2025-12-09T12:52:26.256725Z info tf skipping deployment as specified in the config 2025-12-09T12:52:26.256742Z info tf === SUCCEEDED: Deploy Istio in 3.073327ms [Suite=security_ca_custom_root]=== 2025-12-09T12:52:26.256750Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:52:26.334667Z info tf === SUCCEEDED: Create namespace echo1 in 77.896836ms === Generating RSA private key, 2048 bit long modulus (2 primes) **********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ *************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068/_suite_context/ca-custom-root-3811553871/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ***********************************+++++ ***************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068/_suite_context/ca-custom-root-3811553871/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ******************************************************************************************************+++++ ****+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068/_suite_context/ca-custom-root-3811553871/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:52:27.713662Z info tf === BEGIN: Create namespace external === 2025-12-09T12:52:27.747834Z info tf === SUCCEEDED: Create namespace external in 34.19467ms === 2025-12-09T12:52:28.017745Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:52:28.167256Z error tf === FAILED: Deploy echo instances === 2025-12-09T12:52:28.167316Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068/_suite_context/ServiceAccount-Service.875211304.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:52:28.167375Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:28.167399Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:28.167442Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:28.352443Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068/_suite_context/ServiceAccount-Service.875211304.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:52:28.352547Z info tf === FAILED: Setup: 'security_ca_custom_root' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068/_suite_context/ServiceAccount-Service.875211304.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated) === 2025-12-09T12:52:28.352559Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-17d0068/_suite_context/ServiceAccount-Service.875211304.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:52:28.352610Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:28.352609Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:28.352647Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:52:28.485576Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:52:28.485665Z info tf === SUCCEEDED: Cleanup Istio in 82.086µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root DONE 2 runs, 31 tests, 18 failures in 401.642s exec: [go test -json -test.run=^TestTrustDomainAliasSecureNaming$/^From_primary-0/server:server-naked-foo\[success\]$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 339195 2025-12-09T12:52:40.697980Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:52:40.698052Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:52:40.731684Z info tf === Test Framework Settings === 2025-12-09T12:52:40.731804Z info tf TestID: security_ca_custom_root RunID: 0e4310d6-fa03-49b7-9b0e-15eb94508dc6 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:52:40.731813Z info tf =============================== 2025-12-09T12:52:40.731937Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-0e4310d 2025-12-09T12:52:40.732012Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:52:40.732021Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:52:40.732036Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:52:40.732043Z info tf === BEGIN: Building clusters === 2025-12-09T12:52:40.735075Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:52:40.735084Z info tf === DONE: Building clusters === 2025-12-09T12:52:40.735098Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:52:40.801420Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:52:40.801449Z info tf === SUCCESS: context setup function === 2025-12-09T12:52:40.801457Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:52:40.801466Z info tf === Istio Component Config === 2025-12-09T12:52:40.801505Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:52:40.801511Z info tf ================================ 2025-12-09T12:52:40.805824Z info tf skipping deployment as specified in the config 2025-12-09T12:52:40.805853Z info tf === SUCCEEDED: Deploy Istio in 4.389091ms [Suite=security_ca_custom_root]=== 2025-12-09T12:52:40.805862Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:52:40.874654Z info tf === SUCCEEDED: Create namespace echo1 in 68.767023ms === Generating RSA private key, 2048 bit long modulus (2 primes) *******************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ ************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-0e4310d/_suite_context/ca-custom-root-41804601/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ *******************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-0e4310d/_suite_context/ca-custom-root-41804601/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) **************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ ********************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-0e4310d/_suite_context/ca-custom-root-41804601/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:52:43.525062Z info tf === BEGIN: Create namespace external === 2025-12-09T12:52:43.543479Z info tf === SUCCEEDED: Create namespace external in 18.437543ms === 2025-12-09T12:52:43.682059Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:52:44.885113Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:44.911352Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:44.916717Z info sync complete name=pod controller attempt=5 time=31.542075ms 2025-12-09T12:52:44.918044Z info sync complete name=pod controller attempt=3 time=6.589275ms 2025-12-09T12:52:44.943638Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:44.946494Z info sync complete name=pod controller attempt=2 time=2.807521ms 2025-12-09T12:52:44.950090Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:44.956813Z info sync complete name=pod controller attempt=3 time=6.665017ms 2025-12-09T12:52:44.986158Z info klog Caches are synced controller=echo 2025-12-09T12:52:44.990356Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:44.993061Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:44.993168Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.012166Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.021779Z info sync complete name=pod controller attempt=5 time=31.340445ms 2025-12-09T12:52:45.025059Z info sync complete name=pod controller attempt=5 time=31.866778ms 2025-12-09T12:52:45.025046Z info sync complete name=pod controller attempt=5 time=31.950356ms 2025-12-09T12:52:45.033662Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.034170Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.039566Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.039653Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.039974Z info sync complete name=pod controller attempt=3 time=6.256521ms 2025-12-09T12:52:45.041024Z info sync complete name=pod controller attempt=3 time=6.819583ms 2025-12-09T12:52:45.041689Z info sync complete name=pod controller attempt=2 time=2.067218ms 2025-12-09T12:52:45.041746Z info sync complete name=pod controller attempt=2 time=2.043294ms 2025-12-09T12:52:45.042519Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.042840Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.043882Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.044580Z info sync complete name=pod controller attempt=2 time=2.025682ms 2025-12-09T12:52:45.045022Z info sync complete name=pod controller attempt=2 time=2.127515ms 2025-12-09T12:52:45.051349Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.054825Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:52:45.062266Z info sync complete name=pod controller attempt=3 time=7.410347ms 2025-12-09T12:52:45.090638Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.094195Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.094276Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.134145Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.134248Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.140353Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.140354Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.142876Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.143058Z info klog Caches are synced controller=echo 2025-12-09T12:52:45.155330Z info klog Caches are synced controller=echo 2025-12-09T12:52:56.246504Z info tf === SUCCEEDED: Deploy echo instances in 12.564436719s === 2025-12-09T12:52:56.275446Z info tf === DONE: Setup: 'security_ca_custom_root' (15.540335026s) === 2025-12-09T12:52:56.275503Z info tf === BEGIN: Test Run: 'security_ca_custom_root' === === RUN TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] 2025-12-09T12:52:56.292317Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]]' === test.go:322: failed calling client (cluster=cluster-0)->'http://server-naked-foo:443': call failed from client (cluster=cluster-0) to http://server-naked-foo:443 (using http): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "http://server-naked-foo:443": read tcp 172.21.2.14:58014->172.30.250.67:443: read: connection reset by peer 2025-12-09T12:53:26.299488Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]] (30.007162191s)' === 2025-12-09T12:53:26.299680Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:53:26.299695Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:53:26.299693Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:53:26.442057Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/864a39ed0e-4635-4137-b932-5dbc64550e1c 2025-12-09T12:53:26.442318Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1424s 2025-12-09T12:53:26.442816Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:26.537085Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/86aed9306d-27e9-4a85-934d-0df9b1e17b71 2025-12-09T12:53:26.537131Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2372s 2025-12-09T12:53:26.537680Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:26.629115Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/869ef2c963-46b4-4984-994e-7c2b9ef286ed 2025-12-09T12:53:26.629203Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3292s 2025-12-09T12:53:26.629954Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (30.61s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (re-run 2) (30.61s) === RUN TestTrustDomainAliasSecureNaming/From_primary-0 2025-12-09T12:52:56.292114Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0]' === 2025-12-09T12:53:26.897555Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0] (30.605434346s)' === 2025-12-09T12:53:26.897684Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:53:26.897694Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:53:26.897708Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:53:27.151201Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/864fe4c085-3250-423d-8f5e-4075590a3497 2025-12-09T12:53:27.151453Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2535s 2025-12-09T12:53:27.152047Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.297612Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/86701d3a59-0a82-4cec-9a7d-853f470728f2 2025-12-09T12:53:27.297690Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3997s 2025-12-09T12:53:27.298360Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.402031Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/868d786331-5edb-4079-a2a0-69b456ca2b74 2025-12-09T12:53:27.403789Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5058s 2025-12-09T12:53:27.404871Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming/From_primary-0 (31.29s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming/From_primary-0 (re-run 2) (31.29s) === RUN TestTrustDomainAliasSecureNaming 2025-12-09T12:52:56.275996Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming]' === 2025-12-09T12:53:27.585245Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming] (31.309242689s)' === 2025-12-09T12:53:27.585360Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:53:27.585377Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:53:27.585402Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:53:27.777026Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/860751c5b6-828d-466a-90f6-065c20c8f46a 2025-12-09T12:53:27.777134Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1916s 2025-12-09T12:53:27.777776Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.887977Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/86191227a3-cd74-44c0-869f-ab86c8a9796b 2025-12-09T12:53:27.888204Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3026s 2025-12-09T12:53:27.888818Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.989768Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/862a6e369b-51be-45e2-a832-30d44a33509b 2025-12-09T12:53:27.989845Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4043s 2025-12-09T12:53:27.990837Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainAliasSecureNaming (31.92s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainAliasSecureNaming (re-run 2) (31.92s) 2025-12-09T12:53:28.194932Z info tf === FAILED: Test Run: 'security_ca_custom_root' (exitCode: 1) === 2025-12-09T12:53:28.194983Z info tf === Suite "security_ca_custom_root" run time: 47.459886969s === 2025-12-09T12:53:28.194993Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/trace.yaml 2025-12-09T12:53:28.195226Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:28.195255Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:28.195260Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:28.357791Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:53:28Z/8701ce6970-533b-4823-8030-03415e48eac5 2025-12-09T12:53:28.357976Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1625s 2025-12-09T12:53:28.358650Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:28.440060Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:53:28Z/87b62ce753-60af-4c55-a864-e7e97ce9418b 2025-12-09T12:53:28.440121Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2446s 2025-12-09T12:53:28.440709Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:28.537370Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:53:28Z/872614d191-6941-4c59-a76c-fea1f5417d73 2025-12-09T12:53:28.537452Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3419s 2025-12-09T12:53:28.538079Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:29.320607Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:53:29.320665Z info tf === SUCCEEDED: Cleanup Istio in 52.306µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainAliasSecureNaming$/^From_primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 340855 2025-12-09T12:53:40.903834Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:53:40.903903Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:53:40.948933Z info tf === Test Framework Settings === 2025-12-09T12:53:40.949061Z info tf TestID: security_ca_custom_root RunID: c8ac11e5-595b-4d23-ac69-7c9db7dbf24d NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:53:40.949097Z info tf =============================== 2025-12-09T12:53:40.949242Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e 2025-12-09T12:53:40.949323Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:53:40.949333Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:53:40.949350Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:53:40.949358Z info tf === BEGIN: Building clusters === 2025-12-09T12:53:40.952434Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:53:40.952442Z info tf === DONE: Building clusters === 2025-12-09T12:53:40.952457Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:53:40.992783Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:53:40.992813Z info tf === SUCCESS: context setup function === 2025-12-09T12:53:40.992823Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:53:40.992835Z info tf === Istio Component Config === 2025-12-09T12:53:40.992935Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:53:40.992945Z info tf ================================ 2025-12-09T12:53:40.997678Z info tf skipping deployment as specified in the config 2025-12-09T12:53:40.997701Z info tf === SUCCEEDED: Deploy Istio in 4.870977ms [Suite=security_ca_custom_root]=== 2025-12-09T12:53:40.997711Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:53:41.071833Z info tf === SUCCEEDED: Create namespace echo1 in 73.461879ms === Generating RSA private key, 2048 bit long modulus (2 primes) *******************************************************************+++++ ******************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e/_suite_context/ca-custom-root-1137400645/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) **************************************************************************************************************+++++ ***************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e/_suite_context/ca-custom-root-1137400645/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ***********************************************************************+++++ ***************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e/_suite_context/ca-custom-root-1137400645/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:53:41.996101Z info tf === BEGIN: Create namespace external === 2025-12-09T12:53:42.005578Z info tf === SUCCEEDED: Create namespace external in 9.507783ms === 2025-12-09T12:53:42.101199Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:53:42.121529Z error tf === FAILED: Deploy echo instances === 2025-12-09T12:53:42.121580Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e/_suite_context/Service.2356617107.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-12-09T12:53:42.121619Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:42.121637Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:42.121662Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:42.162015Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e/_suite_context/Service.2356617107.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-12-09T12:53:42.162067Z info tf === FAILED: Setup: 'security_ca_custom_root' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e/_suite_context/Service.2356617107.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-12-09T12:53:42.162073Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-c8ac11e/_suite_context/Service.2356617107.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-12-09T12:53:42.162095Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:42.162111Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:42.162121Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:53:42.211834Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:53:42.211934Z info tf === SUCCEEDED: Cleanup Istio in 94.836µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0/naked\[foo\]->server:http-mtls\[allow\]$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 342282 2025-12-09T12:53:56.274877Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:53:56.274935Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:53:56.313257Z info tf === Test Framework Settings === 2025-12-09T12:53:56.313371Z info tf TestID: security_ca_custom_root RunID: 84b22f1b-4103-473b-b4a3-b822f34c4be7 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:53:56.313380Z info tf =============================== 2025-12-09T12:53:56.313632Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-84b22f1 2025-12-09T12:53:56.313746Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:53:56.313766Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:53:56.313793Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:53:56.313805Z info tf === BEGIN: Building clusters === 2025-12-09T12:53:56.318540Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:53:56.318549Z info tf === DONE: Building clusters === 2025-12-09T12:53:56.318574Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:53:56.349966Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:53:56.350021Z info tf === SUCCESS: context setup function === 2025-12-09T12:53:56.350029Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:53:56.350039Z info tf === Istio Component Config === 2025-12-09T12:53:56.350098Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:53:56.350104Z info tf ================================ 2025-12-09T12:53:56.352997Z info tf skipping deployment as specified in the config 2025-12-09T12:53:56.353015Z info tf === SUCCEEDED: Deploy Istio in 2.978467ms [Suite=security_ca_custom_root]=== 2025-12-09T12:53:56.353025Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:53:56.441042Z info tf === SUCCEEDED: Create namespace echo1 in 88.007263ms === Generating RSA private key, 2048 bit long modulus (2 primes) ***********************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ ************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-84b22f1/_suite_context/ca-custom-root-2874158652/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ******************************************************************************************************************************************************************************+++++ **************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-84b22f1/_suite_context/ca-custom-root-2874158652/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ******************************+++++ *******************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-84b22f1/_suite_context/ca-custom-root-2874158652/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:53:57.518240Z info tf === BEGIN: Create namespace external === 2025-12-09T12:53:57.532689Z info tf === SUCCEEDED: Create namespace external in 14.482895ms === 2025-12-09T12:53:57.693876Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:53:58.822297Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.837712Z info sync complete name=pod controller attempt=4 time=15.280387ms 2025-12-09T12:53:58.849190Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.849809Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.856907Z info sync complete name=pod controller attempt=3 time=7.619574ms 2025-12-09T12:53:58.856926Z info sync complete name=pod controller attempt=3 time=7.075279ms 2025-12-09T12:53:58.908777Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.911036Z info sync complete name=pod controller attempt=2 time=2.159796ms 2025-12-09T12:53:58.921910Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.923395Z info klog Caches are synced controller=echo 2025-12-09T12:53:58.928312Z info sync complete name=pod controller attempt=3 time=6.344685ms 2025-12-09T12:53:58.950034Z info klog Caches are synced controller=echo 2025-12-09T12:53:58.950013Z info klog Caches are synced controller=echo 2025-12-09T12:53:58.954260Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.954195Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.962428Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.968985Z info sync complete name=pod controller attempt=4 time=14.680756ms 2025-12-09T12:53:58.969076Z info sync complete name=pod controller attempt=4 time=14.755212ms 2025-12-09T12:53:58.969490Z info sync complete name=pod controller attempt=3 time=6.988441ms 2025-12-09T12:53:58.976266Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.978701Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.980627Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.990354Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:58.991277Z info sync complete name=pod controller attempt=4 time=14.908779ms 2025-12-09T12:53:58.993813Z info sync complete name=pod controller attempt=4 time=15.0584ms 2025-12-09T12:53:58.995237Z info sync complete name=pod controller attempt=4 time=14.55343ms 2025-12-09T12:53:58.996836Z info sync complete name=pod controller attempt=3 time=6.417759ms 2025-12-09T12:53:59.002450Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:59.002561Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:53:59.009720Z info sync complete name=pod controller attempt=3 time=7.119031ms 2025-12-09T12:53:59.009740Z info sync complete name=pod controller attempt=3 time=7.208041ms 2025-12-09T12:53:59.009843Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.023085Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.054402Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.054501Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.063009Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.076534Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.079128Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.081519Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.091361Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.103285Z info klog Caches are synced controller=echo 2025-12-09T12:53:59.103353Z info klog Caches are synced controller=echo 2025-12-09T12:54:10.209746Z info tf === SUCCEEDED: Deploy echo instances in 12.515855999s === 2025-12-09T12:54:10.240461Z info tf === DONE: Setup: 'security_ca_custom_root' (13.921868019s) === 2025-12-09T12:54:10.240523Z info tf === BEGIN: Test Run: 'security_ca_custom_root' === === RUN TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] 2025-12-09T12:54:10.264682Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'https://server:8091': call failed from naked (cluster=cluster-0) to https://server:8091 (using https): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "https://server:8091": remote error: tls: unknown certificate authority 2025-12-09T12:54:40.265161Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]] (30.000464881s)' === 2025-12-09T12:54:40.265264Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:54:40.265295Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:54:40.265269Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:54:40.411938Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10184652b24-f124-4470-915c-32e70bfcddae 2025-12-09T12:54:40.412335Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1467s 2025-12-09T12:54:40.412966Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:40.507820Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/101220e3a4b-9976-470d-9c8c-be837088cd71 2025-12-09T12:54:40.507950Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2423s 2025-12-09T12:54:40.509048Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:40.609026Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/101c803bb76-1b1b-49f9-87e0-7500baec1955 2025-12-09T12:54:40.609126Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3434s 2025-12-09T12:54:40.609900Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (30.49s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (re-run 2) (30.49s) === RUN TestTrustDomainValidation/From_primary-0 2025-12-09T12:54:10.263948Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:54:40.757893Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.493930879s)' === 2025-12-09T12:54:40.758132Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:54:40.758155Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:54:40.758135Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:54:40.947529Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10139c634cc-57be-4a37-9a7c-4235ca3bd289 2025-12-09T12:54:40.947847Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1895s 2025-12-09T12:54:40.948367Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.048004Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/1010569dbcf-e2ce-480c-96c7-72a72a93d6fb 2025-12-09T12:54:41.048207Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2898s 2025-12-09T12:54:41.049182Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.154042Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/1016e3cc759-2024-42d8-ae36-0037aabb7c44 2025-12-09T12:54:41.154219Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3958s 2025-12-09T12:54:41.155019Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0 (31.06s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0 (re-run 2) (31.06s) === RUN TestTrustDomainValidation 2025-12-09T12:54:10.241056Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:54:41.325203Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (31.084135881s)' === 2025-12-09T12:54:41.325314Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:54:41.325324Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:54:41.325339Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:54:41.472346Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10193c31333-fd07-459e-b78c-bb75d141d4c1 2025-12-09T12:54:41.472490Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.1469s 2025-12-09T12:54:41.473147Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.563618Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/101d6f655d0-381d-4679-918b-f2c9d12f8e66 2025-12-09T12:54:41.563737Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2382s 2025-12-09T12:54:41.564354Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.651841Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10117de3d82-ebf8-465c-a57f-0f688bb38d1c 2025-12-09T12:54:41.652145Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3266s 2025-12-09T12:54:41.653014Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation (31.59s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation (re-run 2) (31.59s) 2025-12-09T12:54:41.835434Z info tf === FAILED: Test Run: 'security_ca_custom_root' (exitCode: 1) === 2025-12-09T12:54:41.835503Z info tf === Suite "security_ca_custom_root" run time: 45.516935218s === 2025-12-09T12:54:41.835515Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/trace.yaml 2025-12-09T12:54:41.835816Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:41.835845Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:41.835827Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:42.009306Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:41Z/102f0674b99-b31d-460e-9a3d-ea21f0749d66 2025-12-09T12:54:42.009522Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1733s 2025-12-09T12:54:42.010136Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:42.112249Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:41Z/102039f6612-3e05-43ad-8f16-6148e68beef2 2025-12-09T12:54:42.112428Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2762s 2025-12-09T12:54:42.113101Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:42.204667Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:41Z/10277f07725-f2f6-46b0-a540-11f784ecccbe 2025-12-09T12:54:42.204797Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3685s 2025-12-09T12:54:42.205964Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:42.378604Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:54:42.378776Z info tf === SUCCEEDED: Cleanup Istio in 163.232µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 343847 2025-12-09T12:54:55.730571Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:54:55.730636Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:54:55.767890Z info tf === Test Framework Settings === 2025-12-09T12:54:55.767979Z info tf TestID: security_ca_custom_root RunID: 410b6f7e-7c8a-47c8-aa60-4d4973621076 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:54:55.767984Z info tf =============================== 2025-12-09T12:54:55.768242Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7 2025-12-09T12:54:55.768379Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:54:55.768402Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:54:55.768428Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:54:55.768443Z info tf === BEGIN: Building clusters === 2025-12-09T12:54:55.771675Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:54:55.771684Z info tf === DONE: Building clusters === 2025-12-09T12:54:55.771707Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:54:55.813866Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:54:55.813923Z info tf === SUCCESS: context setup function === 2025-12-09T12:54:55.813934Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:54:55.813950Z info tf === Istio Component Config === 2025-12-09T12:54:55.814024Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:54:55.814045Z info tf ================================ 2025-12-09T12:54:55.819505Z info tf skipping deployment as specified in the config 2025-12-09T12:54:55.819548Z info tf === SUCCEEDED: Deploy Istio in 5.601281ms [Suite=security_ca_custom_root]=== 2025-12-09T12:54:55.819561Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:54:55.891665Z info tf === SUCCEEDED: Create namespace echo1 in 72.08463ms === Generating RSA private key, 2048 bit long modulus (2 primes) ********************************************************************************************************************************+++++ ***************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7/_suite_context/ca-custom-root-2330238999/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ****************************************************************+++++ *****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7/_suite_context/ca-custom-root-2330238999/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *******************************************************************************************************************************************************************************+++++ *********************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7/_suite_context/ca-custom-root-2330238999/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:54:57.132859Z info tf === BEGIN: Create namespace external === 2025-12-09T12:54:57.153837Z info tf === SUCCEEDED: Create namespace external in 20.996147ms === 2025-12-09T12:54:57.350136Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:54:57.457173Z error tf === FAILED: Deploy echo instances === 2025-12-09T12:54:57.457243Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7/_suite_context/ServiceAccount-Service.475086041.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:54:57.457304Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:57.457331Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:57.457328Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:57.598704Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7/_suite_context/ServiceAccount-Service.475086041.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:54:57.598832Z info tf === FAILED: Setup: 'security_ca_custom_root' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7/_suite_context/ServiceAccount-Service.475086041.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo1 because it is being terminated) === 2025-12-09T12:54:57.598849Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-410b6f7/_suite_context/ServiceAccount-Service.475086041.yaml] to ns echo1 in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:54:57.598916Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:57.598928Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:57.598915Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:54:57.718676Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:54:57.718788Z info tf === SUCCEEDED: Cleanup Istio in 104.919µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0/naked\[foo\]->server:tcp-mtls-pass-through\[allow\]$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 345162 2025-12-09T12:55:11.643867Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:55:11.643924Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:55:11.677470Z info tf === Test Framework Settings === 2025-12-09T12:55:11.677565Z info tf TestID: security_ca_custom_root RunID: 8bcc1874-288b-401d-b71a-f1a4cba731ed NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:55:11.677571Z info tf =============================== 2025-12-09T12:55:11.677752Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-8bcc187 2025-12-09T12:55:11.677840Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:55:11.677855Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:55:11.677874Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:55:11.677883Z info tf === BEGIN: Building clusters === 2025-12-09T12:55:11.681565Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:55:11.681598Z info tf === DONE: Building clusters === 2025-12-09T12:55:11.681619Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:55:11.723540Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:55:11.723613Z info tf === SUCCESS: context setup function === 2025-12-09T12:55:11.723623Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:55:11.723638Z info tf === Istio Component Config === 2025-12-09T12:55:11.723737Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:55:11.723744Z info tf ================================ 2025-12-09T12:55:11.727909Z info tf skipping deployment as specified in the config 2025-12-09T12:55:11.727933Z info tf === SUCCEEDED: Deploy Istio in 4.302088ms [Suite=security_ca_custom_root]=== 2025-12-09T12:55:11.727944Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:55:11.809928Z info tf === SUCCEEDED: Create namespace echo1 in 81.967757ms === Generating RSA private key, 2048 bit long modulus (2 primes) **************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ *******************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-8bcc187/_suite_context/ca-custom-root-397975429/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *******************************************************************************************************************************************************************************************************************************************+++++ ***********************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-8bcc187/_suite_context/ca-custom-root-397975429/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ **************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-8bcc187/_suite_context/ca-custom-root-397975429/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:55:13.701607Z info tf === BEGIN: Create namespace external === 2025-12-09T12:55:13.718946Z info tf === SUCCEEDED: Create namespace external in 17.336736ms === 2025-12-09T12:55:13.858956Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:55:14.958556Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:14.965375Z info sync complete name=pod controller attempt=3 time=6.727545ms 2025-12-09T12:55:14.990103Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:14.996892Z info sync complete name=pod controller attempt=3 time=6.713771ms 2025-12-09T12:55:15.014633Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.016792Z info sync complete name=pod controller attempt=2 time=2.077569ms 2025-12-09T12:55:15.030606Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.035694Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.037293Z info sync complete name=pod controller attempt=3 time=6.625973ms 2025-12-09T12:55:15.039760Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.041030Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.041849Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.042073Z info sync complete name=pod controller attempt=3 time=6.351893ms 2025-12-09T12:55:15.043357Z info sync complete name=pod controller attempt=2 time=2.285583ms 2025-12-09T12:55:15.046005Z info sync complete name=pod controller attempt=3 time=6.221655ms 2025-12-09T12:55:15.048380Z info sync complete name=pod controller attempt=3 time=6.485534ms 2025-12-09T12:55:15.059299Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.059480Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.062947Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.066384Z info sync complete name=pod controller attempt=3 time=6.882718ms 2025-12-09T12:55:15.067584Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.069678Z info sync complete name=pod controller attempt=3 time=6.658025ms 2025-12-09T12:55:15.073954Z info sync complete name=pod controller attempt=3 time=6.346282ms 2025-12-09T12:55:15.074955Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.077627Z info sync complete name=pod controller attempt=2 time=2.641315ms 2025-12-09T12:55:15.089708Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.090338Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.092522Z info sync complete name=pod controller attempt=2 time=2.739392ms 2025-12-09T12:55:15.098726Z info klog Waiting for caches to sync controller=echo 2025-12-09T12:55:15.105747Z info sync complete name=pod controller attempt=3 time=6.977899ms 2025-12-09T12:55:15.115348Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.131528Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.136121Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.140576Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.141969Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.142084Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.160436Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.163579Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.168043Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.175049Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.190871Z info klog Caches are synced controller=echo 2025-12-09T12:55:15.199400Z info klog Caches are synced controller=echo 2025-12-09T12:55:26.297893Z info tf === SUCCEEDED: Deploy echo instances in 12.438914545s === 2025-12-09T12:55:26.329247Z info tf === DONE: Setup: 'security_ca_custom_root' (14.647611433s) === 2025-12-09T12:55:26.329311Z info tf === BEGIN: Test Run: 'security_ca_custom_root' === === RUN TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] 2025-12-09T12:55:26.355664Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://172.23.1.172:9000': call failed from naked (cluster=cluster-0) to tcp://172.23.1.172:9000 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:55:56.362136Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]] (30.006465312s)' === 2025-12-09T12:55:56.362241Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:55:56.362241Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:55:56.362250Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:55:56.486377Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/11884921b48-7017-4a9a-99da-0651b02e327d 2025-12-09T12:55:56.486641Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1241s 2025-12-09T12:55:56.487410Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:56.579595Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/118352ccc49-4ae5-44fe-877f-016a9ebf4588 2025-12-09T12:55:56.579788Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2172s 2025-12-09T12:55:56.580667Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:56.699417Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/11881458615-ea87-4b9a-bef7-dc2a2becd435 2025-12-09T12:55:56.699566Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3369s 2025-12-09T12:55:56.700333Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (30.78s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (re-run 2) (30.78s) === RUN TestTrustDomainValidation/From_primary-0 2025-12-09T12:55:26.354398Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:55:57.140266Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.785858912s)' === 2025-12-09T12:55:57.140425Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:55:57.140426Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:55:57.140452Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:55:57.406501Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/118d3462a14-edfc-4ce3-a687-020e70432591 2025-12-09T12:55:57.406875Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2662s 2025-12-09T12:55:57.407660Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:57.538882Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/11807d25345-5724-49ce-a5a2-6bdb356ae47f 2025-12-09T12:55:57.539017Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3984s 2025-12-09T12:55:57.539958Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:57.715690Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1180ba79193-6dc3-47cc-8585-a3737b8464dd 2025-12-09T12:55:57.715876Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5752s 2025-12-09T12:55:57.716670Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation/From_primary-0 (31.64s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation/From_primary-0 (re-run 2) (31.64s) === RUN TestTrustDomainValidation 2025-12-09T12:55:26.330038Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:55:57.991863Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (31.661810907s)' === 2025-12-09T12:55:57.992070Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:55:57.992069Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:55:57.992066Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:55:58.163792Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1180d798bfa-4bd5-4969-b7e3-98f1b0616777 2025-12-09T12:55:58.164019Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1716s 2025-12-09T12:55:58.164786Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:58.249883Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1183b4d8aca-5641-4c86-be94-c6ed089aadee 2025-12-09T12:55:58.249988Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2576s 2025-12-09T12:55:58.250782Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:58.332348Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1186089db31-a594-4f71-9151-33bf22459ef7 2025-12-09T12:55:58.332463Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3400s 2025-12-09T12:55:58.333360Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestTrustDomainValidation (32.25s) FAIL tests/integration/security/ca_custom_root.TestTrustDomainValidation (re-run 2) (32.25s) 2025-12-09T12:55:58.580607Z info tf === FAILED: Test Run: 'security_ca_custom_root' (exitCode: 1) === 2025-12-09T12:55:58.580673Z info tf === Suite "security_ca_custom_root" run time: 46.899057502s === 2025-12-09T12:55:58.580688Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/trace.yaml 2025-12-09T12:55:58.580906Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:55:58.580923Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:55:58.580940Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:55:58.776708Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:58Z/119faa86eb8-1d7b-4a19-9263-11578d7030b6 2025-12-09T12:55:58.776826Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1957s 2025-12-09T12:55:58.777622Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:58.863819Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:58Z/119494298ee-52f8-48fa-b89f-771c775e083c 2025-12-09T12:55:58.864070Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2829s 2025-12-09T12:55:58.864771Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:58.973548Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:58Z/1199969959d-6819-44b4-931a-7c4df6d6f825 2025-12-09T12:55:58.973714Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3925s 2025-12-09T12:55:58.974436Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:59.155906Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:55:59.156016Z info tf === SUCCEEDED: Cleanup Istio in 100.417µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root exec: [go test -json -test.run=^TestTrustDomainValidation$/^From_primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/security/ca_custom_root -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts] go test pid: 346573 2025-12-09T12:56:11.340560Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:56:11.340625Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3/istio/out/linux_ppc64le does not exist 2025-12-09T12:56:11.390025Z info tf === Test Framework Settings === 2025-12-09T12:56:11.390180Z info tf TestID: security_ca_custom_root RunID: 67ce2f9b-8c59-4636-8ed8-c9187049dacd NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T12:56:11.390193Z info tf =============================== 2025-12-09T12:56:11.390868Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9 2025-12-09T12:56:11.391028Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T12:56:11.391055Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T12:56:11.391089Z info tf Using KubeConfigs: [/root/upi/cA/auth/kubeconfig]. 2025-12-09T12:56:11.391108Z info tf === BEGIN: Building clusters === 2025-12-09T12:56:11.396121Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cA/auth/kubeconfig 2025-12-09T12:56:11.396154Z info tf === DONE: Building clusters === 2025-12-09T12:56:11.396205Z info tf === BEGIN: Setup: 'security_ca_custom_root' === 2025-12-09T12:56:11.516728Z info configmap istio-ca-root-cert is deleted 2025-12-09T12:56:11.516794Z info tf === SUCCESS: context setup function === 2025-12-09T12:56:11.516803Z info tf === BEGIN: Deploy Istio [Suite=security_ca_custom_root] === 2025-12-09T12:56:11.516815Z info tf === Istio Component Config === 2025-12-09T12:56:11.516858Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T12:56:11.516870Z info tf ================================ 2025-12-09T12:56:11.520854Z info tf skipping deployment as specified in the config 2025-12-09T12:56:11.520875Z info tf === SUCCEEDED: Deploy Istio in 4.065956ms [Suite=security_ca_custom_root]=== 2025-12-09T12:56:11.520884Z info tf === BEGIN: Create namespace echo1 === 2025-12-09T12:56:11.536095Z info tf === SUCCEEDED: Create namespace echo1 in 15.199347ms === Generating RSA private key, 2048 bit long modulus (2 primes) *************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ *****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9/_suite_context/ca-custom-root-1854947125/workload-server-naked-foo-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) *****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ *************************************************************************************************************************************************************************************************************************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-bar-[cert|key].pem with URI SAN spiffe://trust-domain-bar/ns/echo1/sa/server-naked-bar /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9/_suite_context/ca-custom-root-1854947125/workload-server-naked-bar-cert.pem: OK Generating RSA private key, 2048 bit long modulus (2 primes) ******************************************************************************************************************************************************************************************************************************************************************************************************************************+++++ ************************************************************************************************+++++ e is 65537 (0x010001) Signature ok subject= Getting CA Private Key Generated workload-server-naked-foo-alt-[cert|key].pem with URI SAN spiffe://trust-domain-foo/ns/echo1/sa/server-naked-foo-alt /home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9/_suite_context/ca-custom-root-1854947125/workload-server-naked-foo-alt-cert.pem: OK 2025-12-09T12:56:13.453941Z info tf === BEGIN: Create namespace external === 2025-12-09T12:56:13.470491Z info tf === SUCCEEDED: Create namespace external in 16.543406ms === 2025-12-09T12:56:13.620601Z info tf === BEGIN: Deploy echo instances === 2025-12-09T12:56:13.666103Z error tf === FAILED: Deploy echo instances === 2025-12-09T12:56:13.666138Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9/_suite_context/ServiceAccount-Service.2184311659.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:56:13.666194Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:56:13.666226Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:56:13.666199Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:56:13.749768Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9/_suite_context/ServiceAccount-Service.2184311659.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:56:13.749834Z info tf === FAILED: Setup: 'security_ca_custom_root' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9/_suite_context/ServiceAccount-Service.2184311659.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated) === 2025-12-09T12:56:13.749840Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/security-ca_custom_root/artifacts/security-ca-custom-root-67ce2f9/_suite_context/ServiceAccount-Service.2184311659.yaml] to ns echo1 in cluster cluster-0: apply: patch: services "a" is forbidden: unable to create new content in namespace echo1 because it is being terminated 2025-12-09T12:56:13.749877Z error tf === Dumping Namespace external State for [suite(security_ca_custom_root)]... 2025-12-09T12:56:13.749897Z error tf === Dumping Istio Deployment State for [suite(security_ca_custom_root)]... 2025-12-09T12:56:13.749972Z error tf === Dumping Namespace echo1 State for [suite(security_ca_custom_root)]... 2025-12-09T12:56:13.880592Z info tf === BEGIN: Cleanup Istio [Suite=security_ca_custom_root] === 2025-12-09T12:56:13.880696Z info tf === SUCCEEDED: Cleanup Istio in 94.048µs [Suite=security_ca_custom_root] === FAIL tests/integration/security/ca_custom_root === Failed === FAIL: tests/integration/security/ca_custom_root TestSecureNaming (10.87s) 2025-12-09T12:46:15.524904Z info tf === BEGIN: Test: 'security_ca_custom_root[TestSecureNaming]' === secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:226: CA certificate root-cert.pem found secure_naming_test.go:114: retry.UntilSuccessOrFail: timeout while waiting after 10 attempts (last error: CA certificate (-----BEGIN CERTIFICATE----- MIIC/TCCAeWgAwIBAgIRAKqk5v6yt+PqhmaTeHc8OOEwDQYJKoZIhvcNAQELBQAw GDEWMBQGA1UEChMNY2x1c3Rlci5sb2NhbDAeFw0yNTEyMDkxMjQyMTZaFw0zNTEy MDcxMjQyMTZaMBgxFjAUBgNVBAoTDWNsdXN0ZXIubG9jYWwwggEiMA0GCSqGSIb3 DQEBAQUAA4IBDwAwggEKAoIBAQDRHY2QPowIXQnoP26H4VEO0Pikg7f4lrGO6oEt Nk7pYPlo2YT5cm9XYzMIgAbkp5XcQg0evTk5ZBCQ4yxInKMvk5vd6oTMKm+70T+Y cjXOMSApj9/tPu0I3ibsF40RrH7Zyl7WCQ7B2dA0OXbfpGWFIs/9pjYlyUAVefNk ow7TJXBxjHDGY3LY7MPLIvWovSJf0LrC9K7+EYCA1tYP74yEzR0VE2yX2tbfZVqt f5KTHjaCV601kD8nKBF6P52uuIkv6agQ7mES9W4lzIUEUQ+urTNojPRxOHAAHj+A ITs+/nJMyrDofPB6zH7qWM62TDbGK1ShBwgkJLyHifV5zQQ5AgMBAAGjQjBAMA4G A1UdDwEB/wQEAwICBDAPBgNVHRMBAf8EBTADAQH/MB0GA1UdDgQWBBQ731kdBEtM 79mTlo5IgtJyuAdMNDANBgkqhkiG9w0BAQsFAAOCAQEAOR0Ue1b0C9vsBGgHnaTN +9uOnR+yppYZb9X9apXRQ9fNpZOlj8AmDCmbWiyG8Y3uK/9J0uwxm5MupCOWOi3W qOUQF16WucwQpEvA/inT4axK2SOwEVJglcmeXPNVN0UfPZasdCAWgJ1oufb9C8d/ b7DkNXN4/qGRAONhGUEAn07I2cQmI3WTlSEmL4bt4NpoKlPj1OwSpZ1IlMjEef+M gq3Om7GSZ8hrfaDTac7KtsALDLZaqHdHzaR1c5OD47vDK48xq9zfwVhyBbKHe3FD iM2MNNOAOAjQp91Ai73NQATSPSwlw0knZO/TpmU4smZna41hcaasF3F6v9a4M89T Gw== -----END CERTIFICATE----- ) not matching plugin cert (-----BEGIN CERTIFICATE----- MIID7TCCAtWgAwIBAgIJAOIRDhOcxsx6MA0GCSqGSIb3DQEBCwUAMIGLMQswCQYD VQQGEwJVUzETMBEGA1UECAwKQ2FsaWZvcm5pYTESMBAGA1UEBwwJU3Vubnl2YWxl MQ4wDAYDVQQKDAVJc3RpbzENMAsGA1UECwwEVGVzdDEQMA4GA1UEAwwHUm9vdCBD QTEiMCAGCSqGSIb3DQEJARYTdGVzdHJvb3RjYUBpc3Rpby5pbzAgFw0xODAxMjQx OTE1NTFaGA8yMTE3MTIzMTE5MTU1MVowgYsxCzAJBgNVBAYTAlVTMRMwEQYDVQQI DApDYWxpZm9ybmlhMRIwEAYDVQQHDAlTdW5ueXZhbGUxDjAMBgNVBAoMBUlzdGlv MQ0wCwYDVQQLDARUZXN0MRAwDgYDVQQDDAdSb290IENBMSIwIAYJKoZIhvcNAQkB FhN0ZXN0cm9vdGNhQGlzdGlvLmlvMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB CgKCAQEA38uEfAatzQYqbaLou1nxJ348VyNzumYMmDDt5pbLYRrCo2pS3ki1ZVDN 8yxIENJFkpKw9UctTGdbNGuGCiSDP7uqF6BiVn+XKAU/3pnPFBbTd0S33NqbDEQu IYraHSl/tSk5rARbC1DrQRdZ6nYD2KrapC4g0XbjY6Pu5l4y7KnFwSunnp9uqpZw uERv/BgumJ5QlSeSeCmhnDhLxooG8w5tC2yVr1yDpsOHGimP/mc8Cds4V0zfIhQv YzfIHphhE9DKjmnjBYLOdj4aycv44jHnOGc+wvA1Jqsl60t3wgms+zJTiWwABLdw zgMAa7yxLyoV0+PiVQud6k+8ZoIFcwIDAQABo1AwTjAdBgNVHQ4EFgQUOUYGtUyh euxO4lGe4Op1y8NVoagwHwYDVR0jBBgwFoAUOUYGtUyheuxO4lGe4Op1y8NVoagw DAYDVR0TBAUwAwEB/zANBgkqhkiG9w0BAQsFAAOCAQEANXLyfAs7J9rmBamGJvPZ ltx390WxzzLFQsBRAaH6rgeipBq3dR9qEjAwb6BTF+ROmtQzX+fjstCRrJxCto9W tC8KvXTdRfIjfCCZjhtIOBKqRxE4KJV/RBfv9xD5lyjtCPCQl3Ia6MSf42N+abAK WCdU6KCojA8WB9YhSCzza3aQbPTzd26OC/JblJpVgtus5f8ILzCsz+pbMimgTkhy AuhYRppJaQ24APijsEC9+GIaVKPg5IwWroiPoj+QXNpshuvqVQQXvGaRiq4zoSnx xAJz+w8tjrDWcf826VN14IL+/Cmqlg/rIfB5CHdwVIfWwpuGB66q/UiPegZMNs8a 3g== -----END CERTIFICATE----- )) 2025-12-09T12:46:25.531776Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestSecureNaming] (10.006866842s)' === 2025-12-09T12:46:25.531870Z error tf === Dumping Namespace external State for TestSecureNaming... 2025-12-09T12:46:25.531883Z error tf === Dumping Istio Deployment State for TestSecureNaming... 2025-12-09T12:46:25.531898Z error tf === Dumping Namespace echo1 State for TestSecureNaming... 2025-12-09T12:46:25.666512Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:15Z/14f388a56c-0ac6-41ff-a168-069b3ac84c70 2025-12-09T12:46:25.666719Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1346s 2025-12-09T12:46:25.667945Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:25.769487Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:15Z/142050a543-8957-4c0c-b0c6-1abbf8cd8dbf 2025-12-09T12:46:25.769617Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2375s 2025-12-09T12:46:25.770430Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:25.862169Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:15Z/141527386b-583c-4ffc-8203-4d61b0e9d3c9 2025-12-09T12:46:25.862261Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3300s 2025-12-09T12:46:25.862920Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:26.007103Z error tf === Dumping Namespace istio-system State for TestSecureNaming... === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (30.61s) 2025-12-09T12:46:26.414005Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]]' === test.go:322: failed calling client (cluster=cluster-0)->'http://server-naked-foo:443': call failed from client (cluster=cluster-0) to http://server-naked-foo:443 (using http): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "http://server-naked-foo:443": read tcp 172.21.3.248:59686->172.30.242.142:443: read: connection reset by peer 2025-12-09T12:46:56.414492Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]] (30.000483286s)' === 2025-12-09T12:46:56.414558Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:46:56.414579Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:46:56.414567Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:46:56.710031Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/153b3daac6-dad8-46ce-8070-966565d50117 2025-12-09T12:46:56.710173Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2953s 2025-12-09T12:46:56.710866Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:56.832025Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15a8ab0c66-e405-4f78-ad98-ed1b9a3c49a4 2025-12-09T12:46:56.832389Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4175s 2025-12-09T12:46:56.832977Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:56.918920Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/1527b7a6c4-ca31-4cc0-9b55-e83a1108b5c8 2025-12-09T12:46:56.919078Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5042s 2025-12-09T12:46:56.919930Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming/From_primary-0 (31.34s) 2025-12-09T12:46:26.413750Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0]' === 2025-12-09T12:46:57.048834Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0] (30.635082588s)' === 2025-12-09T12:46:57.048896Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:46:57.048906Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:46:57.048903Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:46:57.266617Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/159d13da93-e261-4669-94ae-87fb1f0bda70 2025-12-09T12:46:57.267064Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2178s 2025-12-09T12:46:57.267582Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:57.403804Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15aee34fd6-3c2b-485f-9d87-538c9d562cde 2025-12-09T12:46:57.403900Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3545s 2025-12-09T12:46:57.404821Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:57.527474Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15edfa303b-3f7b-4ef0-b063-f1f7b7e1757c 2025-12-09T12:46:57.527755Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4783s 2025-12-09T12:46:57.528370Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming (32.12s) 2025-12-09T12:46:26.393687Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming]' === 2025-12-09T12:46:57.752257Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming] (31.358564906s)' === 2025-12-09T12:46:57.752364Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:46:57.752378Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:46:57.752373Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:46:57.953908Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15de9a6f9f-dfd5-4362-97da-a4ad2b1c2cc8 2025-12-09T12:46:57.954177Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2016s 2025-12-09T12:46:57.955038Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:58.082507Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/152a154519-279c-4168-8d50-0cca971ea815 2025-12-09T12:46:58.082603Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3300s 2025-12-09T12:46:58.083604Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:46:58.229323Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:26Z/15fb0a2d98-6ebb-446b-8bb9-0e0b1bb7ace3 2025-12-09T12:46:58.229499Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4769s 2025-12-09T12:46:58.230489Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (30.59s) 2025-12-09T12:46:59.793728Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'https://server:8091': call failed from naked (cluster=cluster-0) to https://server:8091 (using https): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "https://server:8091": remote error: tls: unknown certificate authority 2025-12-09T12:47:29.795142Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]] (30.001404344s)' === 2025-12-09T12:47:29.795288Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:47:29.795291Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:47:29.795306Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:47:29.975207Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16fcb4e175-60c4-4c67-8ff7-66136dcf7ecf 2025-12-09T12:47:29.975431Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1797s 2025-12-09T12:47:29.976215Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:47:30.072236Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/164caf5929-2110-4eba-8f79-ca0d0c2a76a6 2025-12-09T12:47:30.072306Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2765s 2025-12-09T12:47:30.072995Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:47:30.179811Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1616d76296-3df3-4923-a875-985bdcb966a8 2025-12-09T12:47:30.179886Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3841s 2025-12-09T12:47:30.180592Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow] (30.60s) 2025-12-09T12:47:30.381805Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://server:8093': call failed from naked (cluster=cluster-0) to tcp://server:8093 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:48:00.382168Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]] (30.000355835s)' === 2025-12-09T12:48:00.382267Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]... 2025-12-09T12:48:00.382266Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]... 2025-12-09T12:48:00.382337Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls[allow]... 2025-12-09T12:48:00.539393Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16a3a45d1c-3905-47b4-92ba-9c75d46658a5 2025-12-09T12:48:00.539633Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1571s 2025-12-09T12:48:00.540436Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:00.621531Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16d7336fa3-20a9-4895-a615-3e07fa8f5979 2025-12-09T12:48:00.621657Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2391s 2025-12-09T12:48:00.622453Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:00.704059Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1655d41741-6f0e-430b-9ef9-084d909f1f22 2025-12-09T12:48:00.704175Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3216s 2025-12-09T12:48:00.705175Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (30.78s) 2025-12-09T12:48:00.981942Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://172.21.3.249:9000': call failed from naked (cluster=cluster-0) to tcp://172.21.3.249:9000 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:48:30.983059Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]] (30.001113177s)' === 2025-12-09T12:48:30.983168Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:48:30.983186Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:48:30.983167Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:48:31.160091Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16f1c9b2b2-9285-4a39-b5cb-c5900585ccb9 2025-12-09T12:48:31.160257Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1768s 2025-12-09T12:48:31.161170Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:31.258795Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1691c8bc87-3ace-4857-abd6-5266af36f924 2025-12-09T12:48:31.259047Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2756s 2025-12-09T12:48:31.259807Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:31.350380Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1604c5fa70-a72b-4cc2-8c0f-a696375ddcc8 2025-12-09T12:48:31.350507Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3670s 2025-12-09T12:48:31.351503Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0 (94.02s) 2025-12-09T12:46:58.532336Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:48:31.764328Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (1m33.231982591s)' === 2025-12-09T12:48:31.764440Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:48:31.764449Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:48:31.764471Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:48:31.944498Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/1616f9523b-3642-45e3-8a12-90fd2920c462 2025-12-09T12:48:31.944758Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1801s 2025-12-09T12:48:31.945429Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.044611Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/165d27b154-557c-4e58-bec5-301d95299778 2025-12-09T12:48:32.044754Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2801s 2025-12-09T12:48:32.045674Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.149804Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16a4eae9ee-fad3-4864-a805-8203f2090f13 2025-12-09T12:48:32.149942Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3853s 2025-12-09T12:48:32.151012Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation (94.83s) 2025-12-09T12:46:58.511312Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:48:32.555276Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (1m34.043957833s)' === 2025-12-09T12:48:32.555386Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:48:32.555387Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:48:32.555398Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:48:32.713472Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/162dd1b88f-c16f-404a-9a6f-1354e4c83d22 2025-12-09T12:48:32.713679Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1580s 2025-12-09T12:48:32.714800Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.817168Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16bb2ae4b1-f984-46ba-bf23-aef22edd0581 2025-12-09T12:48:32.817497Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2619s 2025-12-09T12:48:32.818118Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:48:32.904475Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:46:58Z/16909d55a1-2bc4-48f2-b2c7-58369c2c47ed 2025-12-09T12:48:32.904599Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3490s 2025-12-09T12:48:32.905353Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (re-run 1) (30.58s) 2025-12-09T12:49:17.835192Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]]' === test.go:322: failed calling client (cluster=cluster-0)->'http://server-naked-foo:443': call failed from client (cluster=cluster-0) to http://server-naked-foo:443 (using http): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "http://server-naked-foo:443": read tcp 172.23.1.141:35440->172.30.44.111:443: read: connection reset by peer 2025-12-09T12:49:47.841709Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]] (30.006514734s)' === 2025-12-09T12:49:47.841764Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:49:47.841769Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:49:47.841797Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:49:48.029306Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/348e2ae965-8337-4b44-b489-bb58b2c2b6ff 2025-12-09T12:49:48.029604Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1875s 2025-12-09T12:49:48.030247Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.139053Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34cdaf80e6-967d-450d-a7a5-425891357caf 2025-12-09T12:49:48.139197Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2970s 2025-12-09T12:49:48.139987Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.222149Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34eecff9e3-dd23-4e15-86ec-5e7e9559b512 2025-12-09T12:49:48.222245Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3801s 2025-12-09T12:49:48.222881Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming/From_primary-0 (re-run 1) (31.17s) 2025-12-09T12:49:17.834839Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0]' === 2025-12-09T12:49:48.412695Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0] (30.577853325s)' === 2025-12-09T12:49:48.412776Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:49:48.412797Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:49:48.412787Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:49:48.592443Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34066dfd21-aff9-4059-a5f8-f6e73b0e6ff1 2025-12-09T12:49:48.592836Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1798s 2025-12-09T12:49:48.593480Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.696101Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34fe2d9a95-3f1e-4f9d-83e8-1bd0124019b3 2025-12-09T12:49:48.696263Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2832s 2025-12-09T12:49:48.697151Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:48.807581Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34779e66c3-818f-446a-aa69-cea8121ebb27 2025-12-09T12:49:48.807716Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3947s 2025-12-09T12:49:48.808722Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming (re-run 1) (31.70s) 2025-12-09T12:49:17.810487Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming]' === 2025-12-09T12:49:49.009111Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming] (31.198616223s)' === 2025-12-09T12:49:49.009213Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:49:49.009251Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:49:49.009234Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:49:49.156188Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/34d4bd6dc3-230c-4178-8127-347089710ff2 2025-12-09T12:49:49.156480Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1469s 2025-12-09T12:49:49.157035Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:49.247743Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/345bbd0e8d-d340-4d8b-a24b-74b276165c35 2025-12-09T12:49:49.247880Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2384s 2025-12-09T12:49:49.248619Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:49:49.327840Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:49:17Z/344ae7d806-d0aa-4b08-9308-6b640c177546 2025-12-09T12:49:49.327950Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3184s 2025-12-09T12:49:49.328608Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (re-run 1) (30.46s) 2025-12-09T12:50:28.640639Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'https://server:8091': call failed from naked (cluster=cluster-0) to https://server:8091 (using https): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "https://server:8091": remote error: tls: unknown certificate authority 2025-12-09T12:50:58.641155Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]] (30.000506135s)' === 2025-12-09T12:50:58.641271Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:50:58.641286Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:50:58.641271Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:50:58.781452Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49ef4e1db9-6d29-4e8b-99b4-aec5d19a0f66 2025-12-09T12:50:58.781740Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1399s 2025-12-09T12:50:58.782501Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:58.865108Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/499467c12d-a573-4df9-ac08-08b65000e6ec 2025-12-09T12:50:58.865258Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2234s 2025-12-09T12:50:58.866221Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:58.952328Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/4931c7fe17-a7f7-4238-be76-2f5cbf48ff41 2025-12-09T12:50:58.952477Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3106s 2025-12-09T12:50:58.953491Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0 (re-run 1) (30.93s) 2025-12-09T12:50:28.639746Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:50:59.099864Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.460109417s)' === 2025-12-09T12:50:59.099972Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:50:59.099974Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:50:59.099974Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:50:59.227416Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/496dc0aace-a3a9-4b53-980c-73fb6e71c107 2025-12-09T12:50:59.227671Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1275s 2025-12-09T12:50:59.228298Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.327525Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/490b54c87c-72e1-4c80-a6db-109a962ebe5e 2025-12-09T12:50:59.327679Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2275s 2025-12-09T12:50:59.328604Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.414667Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49064af7b8-a364-4a59-a30a-81445225395d 2025-12-09T12:50:59.414852Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3146s 2025-12-09T12:50:59.415620Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation (re-run 1) (31.44s) 2025-12-09T12:50:28.612169Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:50:59.567090Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (30.954905483s)' === 2025-12-09T12:50:59.567253Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:50:59.567251Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:50:59.567280Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:50:59.720539Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/4923f3d04a-7b5b-4322-a5b5-19d8ec18e583 2025-12-09T12:50:59.720699Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1532s 2025-12-09T12:50:59.721616Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.815862Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49b83c7b5b-a2a6-4152-ad36-1642f44fa803 2025-12-09T12:50:59.816100Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2486s 2025-12-09T12:50:59.816843Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:50:59.903731Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:50:28Z/49328e356f-e544-48cb-9249-a9c79cf5b22f 2025-12-09T12:50:59.903872Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3363s 2025-12-09T12:50:59.904620Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (re-run 1) (30.55s) 2025-12-09T12:51:40.849625Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://172.20.3.18:9000': call failed from naked (cluster=cluster-0) to tcp://172.20.3.18:9000 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:52:10.850866Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]] (30.001232692s)' === 2025-12-09T12:52:10.851019Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:52:10.851019Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:52:10.851031Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:52:11.001285Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67673f04dc-21d6-481a-a78a-3706250d6ced 2025-12-09T12:52:11.001670Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1503s 2025-12-09T12:52:11.002323Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.084714Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/6717ede230-8c15-4941-996f-f969eab6877a 2025-12-09T12:52:11.084831Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2334s 2025-12-09T12:52:11.085601Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.199742Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67caa8da30-8f5a-4501-92ba-15f0d121d449 2025-12-09T12:52:11.200017Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3486s 2025-12-09T12:52:11.201275Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0 (re-run 1) (31.11s) 2025-12-09T12:51:40.848732Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:52:11.404402Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.555664116s)' === 2025-12-09T12:52:11.404506Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:52:11.404531Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:52:11.404524Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:52:11.625506Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67aaaff51a-cb21-4199-b7d0-eb807e1d2dd4 2025-12-09T12:52:11.625687Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2209s 2025-12-09T12:52:11.626564Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.727097Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/672b5e86ad-0e39-40cd-a1b1-1e2edfef3469 2025-12-09T12:52:11.727353Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3226s 2025-12-09T12:52:11.727992Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:11.825006Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/6702311452-cf13-4a41-b3fa-15f08171e054 2025-12-09T12:52:11.825116Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4203s 2025-12-09T12:52:11.825878Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation (re-run 1) (31.67s) 2025-12-09T12:51:40.826564Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:52:11.954970Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (31.128395948s)' === 2025-12-09T12:52:11.955104Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:52:11.955105Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:52:11.955128Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:52:12.106008Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67b160d42f-b4ee-4aec-9019-4de4f41da06b 2025-12-09T12:52:12.106439Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1512s 2025-12-09T12:52:12.107148Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:12.196574Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67f812a6d1-1f30-490f-9cf2-25cf12b9e418 2025-12-09T12:52:12.196675Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2414s 2025-12-09T12:52:12.199088Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:52:12.286158Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:51:40Z/67d882ea73-8c46-43fb-91b5-cb2d8b6ce59f 2025-12-09T12:52:12.286283Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3310s 2025-12-09T12:52:12.287328Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success] (re-run 2) (30.61s) 2025-12-09T12:52:56.292317Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]]' === test.go:322: failed calling client (cluster=cluster-0)->'http://server-naked-foo:443': call failed from client (cluster=cluster-0) to http://server-naked-foo:443 (using http): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "http://server-naked-foo:443": read tcp 172.21.2.14:58014->172.30.250.67:443: read: connection reset by peer 2025-12-09T12:53:26.299488Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]] (30.007162191s)' === 2025-12-09T12:53:26.299680Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:53:26.299695Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:53:26.299693Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0/server:server-naked-foo[success]... 2025-12-09T12:53:26.442057Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/864a39ed0e-4635-4137-b932-5dbc64550e1c 2025-12-09T12:53:26.442318Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1424s 2025-12-09T12:53:26.442816Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:26.537085Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/86aed9306d-27e9-4a85-934d-0df9b1e17b71 2025-12-09T12:53:26.537131Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2372s 2025-12-09T12:53:26.537680Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:26.629115Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/869ef2c963-46b4-4984-994e-7c2b9ef286ed 2025-12-09T12:53:26.629203Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3292s 2025-12-09T12:53:26.629954Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming/From_primary-0 (re-run 2) (31.29s) 2025-12-09T12:52:56.292114Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0]' === 2025-12-09T12:53:26.897555Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming/From_primary-0] (30.605434346s)' === 2025-12-09T12:53:26.897684Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:53:26.897694Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:53:26.897708Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming/From_primary-0... 2025-12-09T12:53:27.151201Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/864fe4c085-3250-423d-8f5e-4075590a3497 2025-12-09T12:53:27.151453Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2535s 2025-12-09T12:53:27.152047Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.297612Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/86701d3a59-0a82-4cec-9a7d-853f470728f2 2025-12-09T12:53:27.297690Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3997s 2025-12-09T12:53:27.298360Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.402031Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/868d786331-5edb-4079-a2a0-69b456ca2b74 2025-12-09T12:53:27.403789Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5058s 2025-12-09T12:53:27.404871Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainAliasSecureNaming (re-run 2) (31.92s) 2025-12-09T12:52:56.275996Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming]' === 2025-12-09T12:53:27.585245Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainAliasSecureNaming] (31.309242689s)' === 2025-12-09T12:53:27.585360Z error tf === Dumping Namespace external State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:53:27.585377Z error tf === Dumping Istio Deployment State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:53:27.585402Z error tf === Dumping Namespace echo1 State for TestTrustDomainAliasSecureNaming... 2025-12-09T12:53:27.777026Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/860751c5b6-828d-466a-90f6-065c20c8f46a 2025-12-09T12:53:27.777134Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1916s 2025-12-09T12:53:27.777776Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.887977Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/86191227a3-cd74-44c0-869f-ab86c8a9796b 2025-12-09T12:53:27.888204Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3026s 2025-12-09T12:53:27.888818Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:53:27.989768Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:52:56Z/862a6e369b-51be-45e2-a832-30d44a33509b 2025-12-09T12:53:27.989845Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4043s 2025-12-09T12:53:27.990837Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow] (re-run 2) (30.49s) 2025-12-09T12:54:10.264682Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'https://server:8091': call failed from naked (cluster=cluster-0) to https://server:8091 (using https): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: Get "https://server:8091": remote error: tls: unknown certificate authority 2025-12-09T12:54:40.265161Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]] (30.000464881s)' === 2025-12-09T12:54:40.265264Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:54:40.265295Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:54:40.265269Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:http-mtls[allow]... 2025-12-09T12:54:40.411938Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10184652b24-f124-4470-915c-32e70bfcddae 2025-12-09T12:54:40.412335Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1467s 2025-12-09T12:54:40.412966Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:40.507820Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/101220e3a4b-9976-470d-9c8c-be837088cd71 2025-12-09T12:54:40.507950Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2423s 2025-12-09T12:54:40.509048Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:40.609026Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/101c803bb76-1b1b-49f9-87e0-7500baec1955 2025-12-09T12:54:40.609126Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3434s 2025-12-09T12:54:40.609900Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0 (re-run 2) (31.06s) 2025-12-09T12:54:10.263948Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:54:40.757893Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.493930879s)' === 2025-12-09T12:54:40.758132Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:54:40.758155Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:54:40.758135Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:54:40.947529Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10139c634cc-57be-4a37-9a7c-4235ca3bd289 2025-12-09T12:54:40.947847Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1895s 2025-12-09T12:54:40.948367Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.048004Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/1010569dbcf-e2ce-480c-96c7-72a72a93d6fb 2025-12-09T12:54:41.048207Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2898s 2025-12-09T12:54:41.049182Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.154042Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/1016e3cc759-2024-42d8-ae36-0037aabb7c44 2025-12-09T12:54:41.154219Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3958s 2025-12-09T12:54:41.155019Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation (re-run 2) (31.59s) 2025-12-09T12:54:10.241056Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:54:41.325203Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (31.084135881s)' === 2025-12-09T12:54:41.325314Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:54:41.325324Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:54:41.325339Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:54:41.472346Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10193c31333-fd07-459e-b78c-bb75d141d4c1 2025-12-09T12:54:41.472490Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.1469s 2025-12-09T12:54:41.473147Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.563618Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/101d6f655d0-381d-4679-918b-f2c9d12f8e66 2025-12-09T12:54:41.563737Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2382s 2025-12-09T12:54:41.564354Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:54:41.651841Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:54:10Z/10117de3d82-ebf8-465c-a57f-0f688bb38d1c 2025-12-09T12:54:41.652145Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3266s 2025-12-09T12:54:41.653014Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow] (re-run 2) (30.78s) 2025-12-09T12:55:26.355664Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]]' === test.go:322: failed calling naked (cluster=cluster-0)->'tcp://172.23.1.172:9000': call failed from naked (cluster=cluster-0) to tcp://172.23.1.172:9000 (using tcp): expected no error, but encountered rpc error: code = Unknown desc = 1/1 requests had errors; first error: remote error: tls: unknown certificate authority 2025-12-09T12:55:56.362136Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]] (30.006465312s)' === 2025-12-09T12:55:56.362241Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:55:56.362241Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:55:56.362250Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0/naked[foo]->server:tcp-mtls-pass-through[allow]... 2025-12-09T12:55:56.486377Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/11884921b48-7017-4a9a-99da-0651b02e327d 2025-12-09T12:55:56.486641Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1241s 2025-12-09T12:55:56.487410Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:56.579595Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/118352ccc49-4ae5-44fe-877f-016a9ebf4588 2025-12-09T12:55:56.579788Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2172s 2025-12-09T12:55:56.580667Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:56.699417Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/11881458615-ea87-4b9a-bef7-dc2a2becd435 2025-12-09T12:55:56.699566Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3369s 2025-12-09T12:55:56.700333Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation/From_primary-0 (re-run 2) (31.64s) 2025-12-09T12:55:26.354398Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0]' === 2025-12-09T12:55:57.140266Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation/From_primary-0] (30.785858912s)' === 2025-12-09T12:55:57.140425Z error tf === Dumping Namespace external State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:55:57.140426Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:55:57.140452Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation/From_primary-0... 2025-12-09T12:55:57.406501Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/118d3462a14-edfc-4ce3-a687-020e70432591 2025-12-09T12:55:57.406875Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2662s 2025-12-09T12:55:57.407660Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:57.538882Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/11807d25345-5724-49ce-a5a2-6bdb356ae47f 2025-12-09T12:55:57.539017Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3984s 2025-12-09T12:55:57.539958Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:57.715690Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1180ba79193-6dc3-47cc-8585-a3737b8464dd 2025-12-09T12:55:57.715876Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5752s 2025-12-09T12:55:57.716670Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/security/ca_custom_root TestTrustDomainValidation (re-run 2) (32.25s) 2025-12-09T12:55:26.330038Z info tf === BEGIN: Test: 'security_ca_custom_root[TestTrustDomainValidation]' === 2025-12-09T12:55:57.991863Z info tf === DONE (failed): Test: 'security_ca_custom_root[TestTrustDomainValidation] (31.661810907s)' === 2025-12-09T12:55:57.992070Z error tf === Dumping Namespace echo1 State for TestTrustDomainValidation... 2025-12-09T12:55:57.992069Z error tf === Dumping Namespace external State for TestTrustDomainValidation... 2025-12-09T12:55:57.992066Z error tf === Dumping Istio Deployment State for TestTrustDomainValidation... 2025-12-09T12:55:58.163792Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1180d798bfa-4bd5-4969-b7e3-98f1b0616777 2025-12-09T12:55:58.164019Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1716s 2025-12-09T12:55:58.164786Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:58.249883Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1183b4d8aca-5641-4c86-be94-c6ed089aadee 2025-12-09T12:55:58.249988Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2576s 2025-12-09T12:55:58.250782Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T12:55:58.332348Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T12:55:26Z/1186089db31-a594-4f71-9151-33bf22459ef7 2025-12-09T12:55:58.332463Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3400s 2025-12-09T12:55:58.333360Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF DONE 3 runs, 40 tests, 27 failures in 627.032s exec: go version