exec: [go test -json -tags=integ -timeout 180m ./tests/integration/telemetry/tracing/zipkin -args -istio.test.skipWorkloads=vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts] go test pid: 2180014 2025-12-04T11:32:52.184918Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:32:52.184969Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:32:52.231874Z info tf === Test Framework Settings === 2025-12-04T11:32:52.231985Z info tf TestID: telemetry_tracing_zipkin RunID: 9733e637-0187-42ca-a376-87108b446cd3 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-04T11:32:52.231994Z info tf =============================== 2025-12-04T11:32:52.233672Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-9733e6 2025-12-04T11:32:52.233796Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-04T11:32:52.233819Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-04T11:32:52.233844Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-04T11:32:52.233857Z info tf === BEGIN: Building clusters === 2025-12-04T11:32:52.239229Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-04T11:32:52.239247Z info tf === DONE: Building clusters === 2025-12-04T11:32:52.239291Z info tf === BEGIN: Setup: 'telemetry_tracing_zipkin' === 2025-12-04T11:32:52.239329Z info tf === BEGIN: Deploy Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:32:52.239337Z info tf === Istio Component Config === 2025-12-04T11:32:52.239409Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.proxy.tracer:zipkin global.tag:ibm-p global.variant: meshConfig.enableTracing:true pilot.traceSampling:100.0] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-04T11:32:52.239417Z info tf ================================ 2025-12-04T11:32:52.242715Z info tf skipping deployment as specified in the config 2025-12-04T11:32:52.242737Z info tf === SUCCEEDED: Deploy Istio in 3.400928ms [Suite=telemetry_tracing_zipkin]=== 2025-12-04T11:32:52.242746Z info tf === BEGIN: Create namespace echo === 2025-12-04T11:32:52.268839Z info tf === SUCCEEDED: Create namespace echo in 26.074928ms === 2025-12-04T11:32:52.331840Z info tf === BEGIN: Deploy echo instances === 2025-12-04T11:32:52.592254Z info klog Waiting for caches to sync controller=echo 2025-12-04T11:32:52.594451Z info sync complete name=pod controller attempt=2 time=2.082887ms 2025-12-04T11:32:52.629824Z info klog Waiting for caches to sync controller=echo 2025-12-04T11:32:52.637062Z info sync complete name=pod controller attempt=3 time=7.146244ms 2025-12-04T11:32:52.692572Z info klog Caches are synced controller=echo 2025-12-04T11:32:52.730579Z info klog Caches are synced controller=echo 2025-12-04T11:33:07.001586Z info tf === SUCCEEDED: Deploy echo instances in 14.669733984s === 2025-12-04T11:33:07.133358Z info tf Checking pods ready... 2025-12-04T11:33:07.133416Z info tf Checking pods ready... 2025-12-04T11:33:07.169524Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:07.370169Z info tf Checking pods ready... 2025-12-04T11:33:07.370234Z info tf Checking pods ready... 2025-12-04T11:33:07.374295Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:07.774444Z info tf Checking pods ready... 2025-12-04T11:33:07.774489Z info tf Checking pods ready... 2025-12-04T11:33:07.779525Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:08.580349Z info tf Checking pods ready... 2025-12-04T11:33:08.580408Z info tf Checking pods ready... 2025-12-04T11:33:08.584417Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:10.184486Z info tf Checking pods ready... 2025-12-04T11:33:10.184561Z info tf Checking pods ready... 2025-12-04T11:33:10.189399Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:13.389569Z info tf Checking pods ready... 2025-12-04T11:33:13.389620Z info tf Checking pods ready... 2025-12-04T11:33:13.393929Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:16.594518Z info tf Checking pods ready... 2025-12-04T11:33:16.594558Z info tf Checking pods ready... 2025-12-04T11:33:16.599150Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:19.799531Z info tf Checking pods ready... 2025-12-04T11:33:19.799567Z info tf Checking pods ready... 2025-12-04T11:33:19.803480Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:23.003768Z info tf Checking pods ready... 2025-12-04T11:33:23.003806Z info tf Checking pods ready... 2025-12-04T11:33:23.008249Z info tf [ 0] zipkin-74cc7d9448-99p4d Pending (Pending) 2025-12-04T11:33:26.208683Z info tf Checking pods ready... 2025-12-04T11:33:26.208718Z info tf Checking pods ready... 2025-12-04T11:33:26.213146Z info tf [ 0] zipkin-74cc7d9448-99p4d Running (container not ready: 'zipkin') 2025-12-04T11:33:29.413902Z info tf Checking pods ready... 2025-12-04T11:33:29.413941Z info tf Checking pods ready... 2025-12-04T11:33:29.419062Z info tf [ 0] zipkin-74cc7d9448-99p4d Running (container not ready: 'zipkin') 2025-12-04T11:33:32.620112Z info tf Checking pods ready... 2025-12-04T11:33:32.620143Z info tf Checking pods ready... 2025-12-04T11:33:32.624482Z info tf [ 0] zipkin-74cc7d9448-99p4d Running (Ready) 2025-12-04T11:33:32.713533Z info tf === DONE: Setup: 'telemetry_tracing_zipkin' (40.47422735s) === 2025-12-04T11:33:32.713583Z info tf === BEGIN: Test Run: 'telemetry_tracing_zipkin' === === RUN TestClientTracing/primary-0 2025-12-04T11:33:32.714013Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestClientTracing/primary-0]' === client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:43: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-04T11:36:02.715095Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestClientTracing/primary-0] (2m30.001076185s)' === 2025-12-04T11:36:02.715223Z error tf === Dumping Namespace echo State for TestClientTracing/primary-0... 2025-12-04T11:36:02.715225Z error tf === Dumping Istio Deployment State for TestClientTracing/primary-0... 2025-12-04T11:36:02.838851Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8cc1fe930-fdd9-410d-b14d-72b52b6cb04d 2025-12-04T11:36:02.839014Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1235s 2025-12-04T11:36:02.839706Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:02.957499Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8b76c63a1-826c-43ab-995b-d37ef7075efb 2025-12-04T11:36:02.957602Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2421s 2025-12-04T11:36:02.958252Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:03.072045Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8995584a5-209e-450f-9dab-3b22651b623e 2025-12-04T11:36:03.072301Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3568s 2025-12-04T11:36:03.073138Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestClientTracing/primary-0 (150.47s) FAIL tests/integration/telemetry/tracing/zipkin.TestClientTracing/primary-0 (150.47s) === RUN TestClientTracing 2025-12-04T11:33:32.713879Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestClientTracing]' === 2025-12-04T11:36:03.182535Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestClientTracing] (2m30.4686447s)' === 2025-12-04T11:36:03.182624Z error tf === Dumping Namespace echo State for TestClientTracing... 2025-12-04T11:36:03.182634Z error tf === Dumping Istio Deployment State for TestClientTracing... 2025-12-04T11:36:03.320722Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/865c4645f-cd8a-4124-ae54-bf2204c6df5a 2025-12-04T11:36:03.320925Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1380s 2025-12-04T11:36:03.321505Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:03.428818Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8f0cd8c57-d602-45a4-92bf-b96ba697cf26 2025-12-04T11:36:03.429001Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2461s 2025-12-04T11:36:03.429863Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:03.546765Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8d76d3baf-d435-4223-bdd6-e3c1557452ae 2025-12-04T11:36:03.546893Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3640s 2025-12-04T11:36:03.547532Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestClientTracing (150.90s) FAIL tests/integration/telemetry/tracing/zipkin.TestClientTracing (150.90s) === RUN TestServerTracing/primary-0 2025-12-04T11:36:03.615176Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0]' === server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:42: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-04T11:38:33.615694Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0] (2m30.000514412s)' === 2025-12-04T11:38:33.615810Z error tf === Dumping Namespace echo State for TestServerTracing/primary-0... 2025-12-04T11:38:33.615820Z error tf === Dumping Istio Deployment State for TestServerTracing/primary-0... 2025-12-04T11:38:33.827596Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8bcdd7472-637e-4b3d-b8e6-0359f60590b4 2025-12-04T11:38:33.827818Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2116s 2025-12-04T11:38:33.828632Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:33.934178Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/82c5ab871-6c4a-4bc3-a3e4-cf49c29c6859 2025-12-04T11:38:33.934313Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3181s 2025-12-04T11:38:33.935031Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:34.037355Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8c409c281-7e39-4fa6-9c00-595dd6553b31 2025-12-04T11:38:34.037461Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4213s 2025-12-04T11:38:34.038120Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestServerTracing/primary-0 (150.65s) FAIL tests/integration/telemetry/tracing/zipkin.TestServerTracing/primary-0 (150.65s) === RUN TestServerTracing 2025-12-04T11:36:03.614009Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing]' === 2025-12-04T11:38:34.264033Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing] (2m30.650017369s)' === 2025-12-04T11:38:34.264196Z error tf === Dumping Istio Deployment State for TestServerTracing... 2025-12-04T11:38:34.264197Z error tf === Dumping Namespace echo State for TestServerTracing... 2025-12-04T11:38:34.383272Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/85ed14fee-819a-4c94-8fa0-5e94ba5667a7 2025-12-04T11:38:34.383502Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1192s 2025-12-04T11:38:34.384141Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:34.476378Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/810be0b48-9381-49cc-9897-2050b7509ed9 2025-12-04T11:38:34.476470Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2121s 2025-12-04T11:38:34.477156Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:34.609572Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8aa503cab-51ed-4522-af9c-4b6f8b28bed1 2025-12-04T11:38:34.609763Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3454s 2025-12-04T11:38:34.610530Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestServerTracing (151.30s) FAIL tests/integration/telemetry/tracing/zipkin.TestServerTracing (151.30s) 2025-12-04T11:38:34.912611Z info tf === FAILED: Test Run: 'telemetry_tracing_zipkin' (exitCode: 1) === 2025-12-04T11:38:34.912661Z info tf === Suite "telemetry_tracing_zipkin" run time: 5m42.673372628s === 2025-12-04T11:38:34.912677Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/trace.yaml 2025-12-04T11:38:34.913467Z error tf === Dumping Namespace echo State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:38:34.913485Z error tf === Dumping Istio Deployment State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:38:35.050796Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/880195095-e286-4645-b0c2-e6cf555f9825 2025-12-04T11:38:35.051043Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1373s 2025-12-04T11:38:35.051625Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:35.172029Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8d397d521-e474-4d53-849e-d4d1d5fbe390 2025-12-04T11:38:35.172119Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2584s 2025-12-04T11:38:35.172860Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:35.298872Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/87d174caf-09aa-4e6e-8664-4ce0ee168b66 2025-12-04T11:38:35.299019Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3852s 2025-12-04T11:38:35.299726Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:35.788088Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:38:35.788176Z info tf === SUCCEEDED: Cleanup Istio in 76.189µs [Suite=telemetry_tracing_zipkin] === FAIL tests/integration/telemetry/tracing/zipkin DONE 4 tests, 4 failures in 343.644s exec: [go test -json -test.run=^TestClientTracing$/^primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/telemetry/tracing/zipkin -args -istio.test.skipWorkloads=vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts] go test pid: 2182041 2025-12-04T11:38:47.769805Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:38:47.769864Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:38:47.801949Z info tf === Test Framework Settings === 2025-12-04T11:38:47.802031Z info tf TestID: telemetry_tracing_zipkin RunID: d79f1683-ee9f-413e-95e3-3021a0570f71 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-04T11:38:47.802036Z info tf =============================== 2025-12-04T11:38:47.802194Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-d79f16 2025-12-04T11:38:47.802274Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-04T11:38:47.802286Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-04T11:38:47.802303Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-04T11:38:47.802310Z info tf === BEGIN: Building clusters === 2025-12-04T11:38:47.806091Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-04T11:38:47.806100Z info tf === DONE: Building clusters === 2025-12-04T11:38:47.806117Z info tf === BEGIN: Setup: 'telemetry_tracing_zipkin' === 2025-12-04T11:38:47.806138Z info tf === BEGIN: Deploy Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:38:47.806144Z info tf === Istio Component Config === 2025-12-04T11:38:47.806174Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.proxy.tracer:zipkin global.tag:ibm-p global.variant: meshConfig.enableTracing:true pilot.traceSampling:100.0] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-04T11:38:47.806178Z info tf ================================ 2025-12-04T11:38:47.808286Z info tf skipping deployment as specified in the config 2025-12-04T11:38:47.808300Z info tf === SUCCEEDED: Deploy Istio in 2.157471ms [Suite=telemetry_tracing_zipkin]=== 2025-12-04T11:38:47.808306Z info tf === BEGIN: Create namespace echo === 2025-12-04T11:38:47.825889Z info tf === SUCCEEDED: Create namespace echo in 17.572937ms === 2025-12-04T11:38:47.867727Z info tf === BEGIN: Deploy echo instances === 2025-12-04T11:38:47.881371Z error tf === FAILED: Deploy echo instances === 2025-12-04T11:38:47.881412Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-d79f16/_suite_context/Service.3694633594.yaml] to ns echo in cluster cluster-0: apply: patch: services "client-cluster-0" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-04T11:38:47.881445Z error tf === Dumping Namespace echo State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:38:47.881466Z error tf === Dumping Istio Deployment State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:38:47.897602Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-d79f16/_suite_context/Service.3694633594.yaml] to ns echo in cluster cluster-0: apply: patch: services "client-cluster-0" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-04T11:38:47.897669Z info tf === FAILED: Setup: 'telemetry_tracing_zipkin' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-d79f16/_suite_context/Service.3694633594.yaml] to ns echo in cluster cluster-0: apply: patch: services "client-cluster-0" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-12-04T11:38:47.897675Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-d79f16/_suite_context/Service.3694633594.yaml] to ns echo in cluster cluster-0: apply: patch: services "client-cluster-0" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-04T11:38:47.897699Z error tf === Dumping Namespace echo State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:38:47.897724Z error tf === Dumping Istio Deployment State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:38:48.036220Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:38:48.036292Z info tf === SUCCEEDED: Cleanup Istio in 68.271µs [Suite=telemetry_tracing_zipkin] === FAIL tests/integration/telemetry/tracing/zipkin exec: [go test -json -test.run=^TestServerTracing$/^primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/telemetry/tracing/zipkin -args -istio.test.skipWorkloads=vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts] go test pid: 2183276 2025-12-04T11:39:01.391505Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:39:01.391568Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:39:01.433913Z info tf === Test Framework Settings === 2025-12-04T11:39:01.434004Z info tf TestID: telemetry_tracing_zipkin RunID: 5ad3a14a-c10e-4659-be69-ecb9ac96a3af NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-04T11:39:01.434010Z info tf =============================== 2025-12-04T11:39:01.434269Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-5ad3a1 2025-12-04T11:39:01.434372Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-04T11:39:01.434387Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-04T11:39:01.434409Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-04T11:39:01.434419Z info tf === BEGIN: Building clusters === 2025-12-04T11:39:01.439076Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-04T11:39:01.439122Z info tf === DONE: Building clusters === 2025-12-04T11:39:01.439148Z info tf === BEGIN: Setup: 'telemetry_tracing_zipkin' === 2025-12-04T11:39:01.439191Z info tf === BEGIN: Deploy Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:39:01.439201Z info tf === Istio Component Config === 2025-12-04T11:39:01.439278Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.proxy.tracer:zipkin global.tag:ibm-p global.variant: meshConfig.enableTracing:true pilot.traceSampling:100.0] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-04T11:39:01.439290Z info tf ================================ 2025-12-04T11:39:01.441832Z info tf skipping deployment as specified in the config 2025-12-04T11:39:01.441846Z info tf === SUCCEEDED: Deploy Istio in 2.65201ms [Suite=telemetry_tracing_zipkin]=== 2025-12-04T11:39:01.441852Z info tf === BEGIN: Create namespace echo === 2025-12-04T11:39:01.466329Z info tf === SUCCEEDED: Create namespace echo in 24.463338ms === 2025-12-04T11:39:01.541891Z info tf === BEGIN: Deploy echo instances === 2025-12-04T11:39:02.201378Z info klog Waiting for caches to sync controller=echo 2025-12-04T11:39:02.204162Z info sync complete name=pod controller attempt=2 time=2.731232ms 2025-12-04T11:39:02.301929Z info klog Caches are synced controller=echo 2025-12-04T11:39:02.401493Z info klog Waiting for caches to sync controller=echo 2025-12-04T11:39:02.403649Z info sync complete name=pod controller attempt=2 time=2.085214ms 2025-12-04T11:39:02.502310Z info klog Caches are synced controller=echo 2025-12-04T11:39:15.008289Z info tf === SUCCEEDED: Deploy echo instances in 13.46638519s === 2025-12-04T11:39:15.144968Z info tf Checking pods ready... 2025-12-04T11:39:15.145000Z info tf Checking pods ready... 2025-12-04T11:39:15.164802Z info tf [ 0] zipkin-74cc7d9448-kpv6t Pending (Pending) 2025-12-04T11:39:15.365797Z info tf Checking pods ready... 2025-12-04T11:39:15.365825Z info tf Checking pods ready... 2025-12-04T11:39:15.370759Z info tf [ 0] zipkin-74cc7d9448-kpv6t Pending (Pending) 2025-12-04T11:39:15.771631Z info tf Checking pods ready... 2025-12-04T11:39:15.771745Z info tf Checking pods ready... 2025-12-04T11:39:15.776795Z info tf [ 0] zipkin-74cc7d9448-kpv6t Pending (Pending) 2025-12-04T11:39:16.576934Z info tf Checking pods ready... 2025-12-04T11:39:16.576973Z info tf Checking pods ready... 2025-12-04T11:39:16.582312Z info tf [ 0] zipkin-74cc7d9448-kpv6t Pending (Pending) 2025-12-04T11:39:18.182816Z info tf Checking pods ready... 2025-12-04T11:39:18.182894Z info tf Checking pods ready... 2025-12-04T11:39:18.189532Z info tf [ 0] zipkin-74cc7d9448-kpv6t Running (container not ready: 'zipkin') 2025-12-04T11:39:21.389647Z info tf Checking pods ready... 2025-12-04T11:39:21.389671Z info tf Checking pods ready... 2025-12-04T11:39:21.395668Z info tf [ 0] zipkin-74cc7d9448-kpv6t Running (container not ready: 'zipkin') 2025-12-04T11:39:24.596037Z info tf Checking pods ready... 2025-12-04T11:39:24.596067Z info tf Checking pods ready... 2025-12-04T11:39:24.600716Z info tf [ 0] zipkin-74cc7d9448-kpv6t Running (Ready) 2025-12-04T11:39:24.669900Z info tf === DONE: Setup: 'telemetry_tracing_zipkin' (23.230740434s) === 2025-12-04T11:39:24.669929Z info tf === BEGIN: Test Run: 'telemetry_tracing_zipkin' === === RUN TestServerTracing/primary-0 2025-12-04T11:39:24.670385Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0]' === server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:42: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-04T11:41:54.671527Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0] (2m30.00113822s)' === 2025-12-04T11:41:54.671656Z error tf === Dumping Namespace echo State for TestServerTracing/primary-0... 2025-12-04T11:41:54.671677Z error tf === Dumping Istio Deployment State for TestServerTracing/primary-0... 2025-12-04T11:41:54.876244Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/172c5278e0-3a2f-4974-89c3-2ecd87d115e1 2025-12-04T11:41:54.876537Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2046s 2025-12-04T11:41:54.877222Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:54.979534Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/179bc3e327-2362-4735-b5d2-89f3659fdbd5 2025-12-04T11:41:54.979629Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3077s 2025-12-04T11:41:54.980384Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestServerTracing/primary-0 (150.42s) FAIL tests/integration/telemetry/tracing/zipkin.TestServerTracing/primary-0 (re-run 1) (150.42s) === RUN TestServerTracing 2025-12-04T11:39:24.670254Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing]' === 2025-12-04T11:41:55.091844Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing] (2m30.421586538s)' === 2025-12-04T11:41:55.091897Z error tf === Dumping Namespace echo State for TestServerTracing... 2025-12-04T11:41:55.091912Z error tf === Dumping Istio Deployment State for TestServerTracing... 2025-12-04T11:41:55.107637Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/17bdd8ec63-658b-4779-bf92-acfa85dc86c4 2025-12-04T11:41:55.107748Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4358s 2025-12-04T11:41:55.108399Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.306472Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/177ace463b-c6e1-4125-a128-0e32a825bc8d 2025-12-04T11:41:55.306680Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2146s 2025-12-04T11:41:55.307358Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.399382Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/177286b292-350f-45c4-b2ea-a5554b355515 2025-12-04T11:41:55.399512Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3074s 2025-12-04T11:41:55.400210Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.517877Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/17bebe643c-d318-4bb4-8122-cd4531f1ad20 2025-12-04T11:41:55.517970Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4258s 2025-12-04T11:41:55.518837Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestServerTracing (150.90s) FAIL tests/integration/telemetry/tracing/zipkin.TestServerTracing (re-run 1) (150.90s) 2025-12-04T11:41:55.567486Z info tf === FAILED: Test Run: 'telemetry_tracing_zipkin' (exitCode: 1) === 2025-12-04T11:41:55.567530Z info tf === Suite "telemetry_tracing_zipkin" run time: 2m54.128383959s === 2025-12-04T11:41:55.567551Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/trace.yaml 2025-12-04T11:41:55.567791Z error tf === Dumping Namespace echo State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:41:55.567799Z error tf === Dumping Istio Deployment State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:41:55.707542Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/175c7f0b22-d28b-4718-85d4-faa5871542ed 2025-12-04T11:41:55.707803Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1398s 2025-12-04T11:41:55.708455Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.831437Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/17ce0b1bb9-11b6-4bb7-84e1-3694a066209f 2025-12-04T11:41:55.831562Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2635s 2025-12-04T11:41:55.832324Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.988376Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/17b7a8c685-365f-401a-82a1-554655f7193d 2025-12-04T11:41:55.988480Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4204s 2025-12-04T11:41:55.989170Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:56.325732Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:41:56.325812Z info tf === SUCCEEDED: Cleanup Istio in 75.462µs [Suite=telemetry_tracing_zipkin] === FAIL tests/integration/telemetry/tracing/zipkin DONE 2 runs, 6 tests, 6 failures in 544.180s exec: [go test -json -test.run=^TestServerTracing$/^primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/telemetry/tracing/zipkin -args -istio.test.skipWorkloads=vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts] go test pid: 2184934 2025-12-04T11:42:08.644342Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:42:08.644400Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio/out/linux_ppc64le does not exist 2025-12-04T11:42:08.683490Z info tf === Test Framework Settings === 2025-12-04T11:42:08.683572Z info tf TestID: telemetry_tracing_zipkin RunID: ed307784-77e5-4074-b4d2-bc13f5ca8b7b NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-04T11:42:08.683577Z info tf =============================== 2025-12-04T11:42:08.683978Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077 2025-12-04T11:42:08.684061Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-04T11:42:08.684073Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-04T11:42:08.684090Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-04T11:42:08.684096Z info tf === BEGIN: Building clusters === 2025-12-04T11:42:08.688365Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-04T11:42:08.688373Z info tf === DONE: Building clusters === 2025-12-04T11:42:08.688393Z info tf === BEGIN: Setup: 'telemetry_tracing_zipkin' === 2025-12-04T11:42:08.688420Z info tf === BEGIN: Deploy Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:42:08.688426Z info tf === Istio Component Config === 2025-12-04T11:42:08.688462Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.proxy.tracer:zipkin global.tag:ibm-p global.variant: meshConfig.enableTracing:true pilot.traceSampling:100.0] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-04T11:42:08.688468Z info tf ================================ 2025-12-04T11:42:08.690669Z info tf skipping deployment as specified in the config 2025-12-04T11:42:08.690683Z info tf === SUCCEEDED: Deploy Istio in 2.258194ms [Suite=telemetry_tracing_zipkin]=== 2025-12-04T11:42:08.690689Z info tf === BEGIN: Create namespace echo === 2025-12-04T11:42:08.927868Z info tf === SUCCEEDED: Create namespace echo in 237.164584ms === 2025-12-04T11:42:10.721713Z info tf === BEGIN: Deploy echo instances === 2025-12-04T11:42:10.840235Z error tf === FAILED: Deploy echo instances === 2025-12-04T11:42:10.840298Z error tf 2 errors occurred: * failed deploying echo server.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.1561426374.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "server-v1" is forbidden: unable to create new content in namespace echo because it is being terminated * failed deploying echo client-cluster-0.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.934366520.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "client-cluster-0-v1" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-04T11:42:10.840349Z error tf === Dumping Namespace echo State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:42:10.840354Z error tf === Dumping Istio Deployment State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:42:10.858074Z error tf Test setup error: 2 errors occurred: * failed deploying echo server.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.1561426374.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "server-v1" is forbidden: unable to create new content in namespace echo because it is being terminated * failed deploying echo client-cluster-0.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.934366520.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "client-cluster-0-v1" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-04T11:42:10.858156Z info tf === FAILED: Setup: 'telemetry_tracing_zipkin' (2 errors occurred: * failed deploying echo server.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.1561426374.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "server-v1" is forbidden: unable to create new content in namespace echo because it is being terminated * failed deploying echo client-cluster-0.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.934366520.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "client-cluster-0-v1" is forbidden: unable to create new content in namespace echo because it is being terminated ) === 2025-12-04T11:42:10.858169Z error tf Exiting due to setup failure: 2 errors occurred: * failed deploying echo server.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.1561426374.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "server-v1" is forbidden: unable to create new content in namespace echo because it is being terminated * failed deploying echo client-cluster-0.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-zipkin/artifacts/telemetry-tracing-zipkin-ed3077/_suite_context/Deployment.934366520.yaml] to ns echo in cluster cluster-0: apply: patch: deployments.apps "client-cluster-0-v1" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-04T11:42:10.858211Z error tf === Dumping Namespace echo State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:42:10.858211Z error tf === Dumping Istio Deployment State for [suite(telemetry_tracing_zipkin)]... 2025-12-04T11:42:10.873598Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_tracing_zipkin] === 2025-12-04T11:42:10.873688Z info tf === SUCCEEDED: Cleanup Istio in 84.015µs [Suite=telemetry_tracing_zipkin] === FAIL tests/integration/telemetry/tracing/zipkin === Failed === FAIL: tests/integration/telemetry/tracing/zipkin TestClientTracing/primary-0 (150.47s) 2025-12-04T11:33:32.714013Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestClientTracing/primary-0]' === client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:49: Sending from cluster-0... client_tracing_test.go:43: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-04T11:36:02.715095Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestClientTracing/primary-0] (2m30.001076185s)' === 2025-12-04T11:36:02.715223Z error tf === Dumping Namespace echo State for TestClientTracing/primary-0... 2025-12-04T11:36:02.715225Z error tf === Dumping Istio Deployment State for TestClientTracing/primary-0... 2025-12-04T11:36:02.838851Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8cc1fe930-fdd9-410d-b14d-72b52b6cb04d 2025-12-04T11:36:02.839014Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1235s 2025-12-04T11:36:02.839706Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:02.957499Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8b76c63a1-826c-43ab-995b-d37ef7075efb 2025-12-04T11:36:02.957602Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2421s 2025-12-04T11:36:02.958252Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:03.072045Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8995584a5-209e-450f-9dab-3b22651b623e 2025-12-04T11:36:03.072301Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3568s 2025-12-04T11:36:03.073138Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/tracing/zipkin TestClientTracing (150.90s) 2025-12-04T11:33:32.713879Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestClientTracing]' === 2025-12-04T11:36:03.182535Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestClientTracing] (2m30.4686447s)' === 2025-12-04T11:36:03.182624Z error tf === Dumping Namespace echo State for TestClientTracing... 2025-12-04T11:36:03.182634Z error tf === Dumping Istio Deployment State for TestClientTracing... 2025-12-04T11:36:03.320722Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/865c4645f-cd8a-4124-ae54-bf2204c6df5a 2025-12-04T11:36:03.320925Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1380s 2025-12-04T11:36:03.321505Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:03.428818Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8f0cd8c57-d602-45a4-92bf-b96ba697cf26 2025-12-04T11:36:03.429001Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2461s 2025-12-04T11:36:03.429863Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:36:03.546765Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8d76d3baf-d435-4223-bdd6-e3c1557452ae 2025-12-04T11:36:03.546893Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3640s 2025-12-04T11:36:03.547532Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/tracing/zipkin TestServerTracing/primary-0 (150.65s) 2025-12-04T11:36:03.615176Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0]' === server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:42: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-04T11:38:33.615694Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0] (2m30.000514412s)' === 2025-12-04T11:38:33.615810Z error tf === Dumping Namespace echo State for TestServerTracing/primary-0... 2025-12-04T11:38:33.615820Z error tf === Dumping Istio Deployment State for TestServerTracing/primary-0... 2025-12-04T11:38:33.827596Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8bcdd7472-637e-4b3d-b8e6-0359f60590b4 2025-12-04T11:38:33.827818Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2116s 2025-12-04T11:38:33.828632Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:33.934178Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/82c5ab871-6c4a-4bc3-a3e4-cf49c29c6859 2025-12-04T11:38:33.934313Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3181s 2025-12-04T11:38:33.935031Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:34.037355Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8c409c281-7e39-4fa6-9c00-595dd6553b31 2025-12-04T11:38:34.037461Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4213s 2025-12-04T11:38:34.038120Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/tracing/zipkin TestServerTracing (151.30s) 2025-12-04T11:36:03.614009Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing]' === 2025-12-04T11:38:34.264033Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing] (2m30.650017369s)' === 2025-12-04T11:38:34.264196Z error tf === Dumping Istio Deployment State for TestServerTracing... 2025-12-04T11:38:34.264197Z error tf === Dumping Namespace echo State for TestServerTracing... 2025-12-04T11:38:34.383272Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/85ed14fee-819a-4c94-8fa0-5e94ba5667a7 2025-12-04T11:38:34.383502Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1192s 2025-12-04T11:38:34.384141Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:34.476378Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/810be0b48-9381-49cc-9897-2050b7509ed9 2025-12-04T11:38:34.476470Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2121s 2025-12-04T11:38:34.477156Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:38:34.609572Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:33:32Z/8aa503cab-51ed-4522-af9c-4b6f8b28bed1 2025-12-04T11:38:34.609763Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3454s 2025-12-04T11:38:34.610530Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/tracing/zipkin TestServerTracing/primary-0 (re-run 1) (150.42s) 2025-12-04T11:39:24.670385Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0]' === server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:43: Sending from cluster-0... server_tracing_test.go:42: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-04T11:41:54.671527Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing/primary-0] (2m30.00113822s)' === 2025-12-04T11:41:54.671656Z error tf === Dumping Namespace echo State for TestServerTracing/primary-0... 2025-12-04T11:41:54.671677Z error tf === Dumping Istio Deployment State for TestServerTracing/primary-0... 2025-12-04T11:41:54.876244Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/172c5278e0-3a2f-4974-89c3-2ecd87d115e1 2025-12-04T11:41:54.876537Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2046s 2025-12-04T11:41:54.877222Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:54.979534Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/179bc3e327-2362-4735-b5d2-89f3659fdbd5 2025-12-04T11:41:54.979629Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3077s 2025-12-04T11:41:54.980384Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/tracing/zipkin TestServerTracing (re-run 1) (150.90s) 2025-12-04T11:39:24.670254Z info tf === BEGIN: Test: 'telemetry_tracing_zipkin[TestServerTracing]' === 2025-12-04T11:41:55.091844Z info tf === DONE (failed): Test: 'telemetry_tracing_zipkin[TestServerTracing] (2m30.421586538s)' === 2025-12-04T11:41:55.091897Z error tf === Dumping Namespace echo State for TestServerTracing... 2025-12-04T11:41:55.091912Z error tf === Dumping Istio Deployment State for TestServerTracing... 2025-12-04T11:41:55.107637Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/17bdd8ec63-658b-4779-bf92-acfa85dc86c4 2025-12-04T11:41:55.107748Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4358s 2025-12-04T11:41:55.108399Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.306472Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/177ace463b-c6e1-4125-a128-0e32a825bc8d 2025-12-04T11:41:55.306680Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2146s 2025-12-04T11:41:55.307358Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.399382Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/177286b292-350f-45c4-b2ea-a5554b355515 2025-12-04T11:41:55.399512Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3074s 2025-12-04T11:41:55.400210Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-04T11:41:55.517877Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-04T11:39:24Z/17bebe643c-d318-4bb4-8122-cd4531f1ad20 2025-12-04T11:41:55.517970Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4258s 2025-12-04T11:41:55.518837Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF DONE 3 runs, 6 tests, 6 failures in 558.726s exec: go version