exec: [go test -json -tags=integ -timeout 180m ./tests/integration/telemetry/tracing/otelcollector -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-otelcollector/artifacts] go test pid: 3386268 2025-12-09T10:25:25.061193Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T10:25:25.061234Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T10:25:25.090941Z info tf === Test Framework Settings === 2025-12-09T10:25:25.091005Z info tf TestID: telemetry_tracing_otelcollector RunID: e0276221-4504-499a-9f63-eb5727da2ce3 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-otelcollector/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T10:25:25.091010Z info tf =============================== 2025-12-09T10:25:25.091363Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-otelcollector/artifacts/telemetry-tracing-otelcollector- 2025-12-09T10:25:25.091403Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T10:25:25.091411Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T10:25:25.091427Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-09T10:25:25.091433Z info tf === BEGIN: Building clusters === 2025-12-09T10:25:25.095238Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-09T10:25:25.095250Z info tf === DONE: Building clusters === 2025-12-09T10:25:25.095265Z info tf === BEGIN: Setup: 'telemetry_tracing_otelcollector' === 2025-12-09T10:25:25.149265Z info tf === SUCCESS: context setup function === 2025-12-09T10:25:25.149294Z info tf === BEGIN: Deploy Istio [Suite=telemetry_tracing_otelcollector] === 2025-12-09T10:25:25.149303Z info tf === Istio Component Config === 2025-12-09T10:25:25.149337Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T10:25:25.149342Z info tf ================================ 2025-12-09T10:25:25.153610Z info tf skipping deployment as specified in the config 2025-12-09T10:25:25.153633Z info tf === SUCCEEDED: Deploy Istio in 4.333591ms [Suite=telemetry_tracing_otelcollector]=== 2025-12-09T10:25:25.153644Z info tf === BEGIN: Create namespace echo === 2025-12-09T10:25:25.265963Z info tf === SUCCEEDED: Create namespace echo in 112.304789ms === 2025-12-09T10:25:25.699943Z info tf === BEGIN: Deploy echo instances === 2025-12-09T10:25:26.983955Z info klog Waiting for caches to sync controller=echo 2025-12-09T10:25:27.084978Z info klog Caches are synced controller=echo 2025-12-09T10:25:27.375029Z info klog Waiting for caches to sync controller=echo 2025-12-09T10:25:27.475900Z info klog Caches are synced controller=echo 2025-12-09T10:25:35.381080Z info tf === SUCCEEDED: Deploy echo instances in 9.68110931s === 2025-12-09T10:25:35.478428Z info tf Checking pods ready... 2025-12-09T10:25:35.478474Z info tf Checking pods ready... 2025-12-09T10:25:35.489750Z info tf [ 0] zipkin-74cc7d9448-4twfw Pending (Pending) 2025-12-09T10:25:35.690806Z info tf Checking pods ready... 2025-12-09T10:25:35.690888Z info tf Checking pods ready... 2025-12-09T10:25:35.697916Z info tf [ 0] zipkin-74cc7d9448-4twfw Pending (Pending) 2025-12-09T10:25:36.099040Z info tf Checking pods ready... 2025-12-09T10:25:36.099094Z info tf Checking pods ready... 2025-12-09T10:25:36.104669Z info tf [ 0] zipkin-74cc7d9448-4twfw Pending (Pending) 2025-12-09T10:25:36.905530Z info tf Checking pods ready... 2025-12-09T10:25:36.905567Z info tf Checking pods ready... 2025-12-09T10:25:36.910428Z info tf [ 0] zipkin-74cc7d9448-4twfw Pending (Pending) 2025-12-09T10:25:38.511216Z info tf Checking pods ready... 2025-12-09T10:25:38.511240Z info tf Checking pods ready... 2025-12-09T10:25:38.515421Z info tf [ 0] zipkin-74cc7d9448-4twfw Running (container not ready: 'zipkin') 2025-12-09T10:25:41.715865Z info tf Checking pods ready... 2025-12-09T10:25:41.715919Z info tf Checking pods ready... 2025-12-09T10:25:41.719975Z info tf [ 0] zipkin-74cc7d9448-4twfw Running (container not ready: 'zipkin') 2025-12-09T10:25:44.920056Z info tf Checking pods ready... 2025-12-09T10:25:44.920124Z info tf Checking pods ready... 2025-12-09T10:25:44.923569Z info tf [ 0] zipkin-74cc7d9448-4twfw Running (Ready) 2025-12-09T10:25:45.039844Z info tf Checking pods ready... 2025-12-09T10:25:45.039876Z info tf Checking pods ready... 2025-12-09T10:25:45.052003Z info tf Failed retrieving pods: no matching pod found for selectors: [app=opentelemetry-collector] 2025-12-09T10:25:45.252599Z info tf Checking pods ready... 2025-12-09T10:25:45.252668Z info tf Checking pods ready... 2025-12-09T10:25:45.257273Z info tf [ 0] opentelemetry-collector-749d46955f-mcc8z Pending (Pending) 2025-12-09T10:25:45.658085Z info tf Checking pods ready... 2025-12-09T10:25:45.658135Z info tf Checking pods ready... 2025-12-09T10:25:45.661856Z info tf [ 0] opentelemetry-collector-749d46955f-mcc8z Pending (Pending) 2025-12-09T10:25:46.462758Z info tf Checking pods ready... 2025-12-09T10:25:46.462800Z info tf Checking pods ready... 2025-12-09T10:25:46.467042Z info tf [ 0] opentelemetry-collector-749d46955f-mcc8z Pending (Pending) 2025-12-09T10:25:48.068014Z info tf Checking pods ready... 2025-12-09T10:25:48.068049Z info tf Checking pods ready... 2025-12-09T10:25:48.072162Z info tf [ 0] opentelemetry-collector-749d46955f-mcc8z Running (Ready) 2025-12-09T10:25:48.107610Z info tf === DONE: Setup: 'telemetry_tracing_otelcollector' (23.012334122s) === 2025-12-09T10:25:48.107636Z info tf === BEGIN: Test Run: 'telemetry_tracing_otelcollector' === === RUN TestProxyTracingOpenTelemetryProvider/grpc_exporter/primary-0 2025-12-09T10:25:48.116957Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter/primary-0]' === tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:119: retry.UntilSuccessOrFail: timeout while waiting after 48 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-09T10:28:18.117283Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter/primary-0] (2m30.00032256s)' === 2025-12-09T10:28:18.117374Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/grpc_exporter/primary-0... 2025-12-09T10:28:18.117374Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/grpc_exporter/primary-0... 2025-12-09T10:28:18.411385Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:25:48Z/1245c445cf-3a43-492e-8c76-eb09f9ad6a01 2025-12-09T10:28:18.411750Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2941s 2025-12-09T10:28:18.413295Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:28:18.534637Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:25:48Z/1249afc242-2d79-4899-8b63-7d9a419ab43d 2025-12-09T10:28:18.534753Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4170s 2025-12-09T10:28:18.535290Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:28:18.692800Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:25:48Z/1262813a5b-c76d-4038-9b5b-a8289c496957 2025-12-09T10:28:18.692902Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5752s 2025-12-09T10:28:18.693556Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/grpc_exporter/primary-0 (150.91s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/grpc_exporter/primary-0 (150.91s) === RUN TestProxyTracingOpenTelemetryProvider/grpc_exporter 2025-12-09T10:25:48.107852Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter]' === 2025-12-09T10:28:19.027272Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter] (2m30.919414908s)' === 2025-12-09T10:28:19.027363Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/grpc_exporter... 2025-12-09T10:28:19.027381Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/grpc_exporter... 2025-12-09T10:28:19.377879Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:25:48Z/12047b96ff-bcc2-4b43-8767-64759e5bbdab 2025-12-09T10:28:19.378266Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3507s 2025-12-09T10:28:19.378832Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:28:19.621947Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:25:48Z/12fb93dcd4-aa49-43d1-88ab-b104761ff1cd 2025-12-09T10:28:19.622058Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5945s 2025-12-09T10:28:19.622815Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:28:19.724066Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:25:48Z/127bff1298-711b-40c5-a738-0bca11beef87 2025-12-09T10:28:19.724181Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6965s 2025-12-09T10:28:19.724821Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/grpc_exporter (152.03s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/grpc_exporter (152.03s) === RUN TestProxyTracingOpenTelemetryProvider/http_exporter/primary-0 2025-12-09T10:28:20.765731Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/http_exporter/primary-0]' === tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:119: retry.UntilSuccessOrFail: timeout while waiting after 48 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-09T10:30:50.766972Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/http_exporter/primary-0] (2m30.001237366s)' === 2025-12-09T10:30:50.767099Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/http_exporter/primary-0... 2025-12-09T10:30:50.767121Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/http_exporter/primary-0... 2025-12-09T10:30:51.283050Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:28:20Z/14f06cd685-9386-4553-b2ba-a667b6696e08 2025-12-09T10:30:51.283163Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5153s 2025-12-09T10:30:51.283746Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:30:51.562465Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:28:20Z/14942724d8-e704-4f51-bafb-455701987fc1 2025-12-09T10:30:51.562780Z info tf istioctl ([x internal-debug --all configz]): completed after 0.7950s 2025-12-09T10:30:51.563193Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/http_exporter/primary-0 (151.68s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/http_exporter/primary-0 (151.68s) === RUN TestProxyTracingOpenTelemetryProvider/http_exporter 2025-12-09T10:28:20.136980Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/http_exporter]' === 2025-12-09T10:30:52.445276Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/http_exporter] (2m32.308288427s)' === 2025-12-09T10:30:52.445382Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/http_exporter... 2025-12-09T10:30:52.445398Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/http_exporter... 2025-12-09T10:30:52.514133Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:28:20Z/143e807c8a-bc5b-4b55-b5b6-aaa78b4df74d 2025-12-09T10:30:52.514217Z info tf istioctl ([x internal-debug --all clusterz]): completed after 1.7464s 2025-12-09T10:30:52.514767Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:30:52.663702Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:28:20Z/140ca0cd70-edda-4347-a762-2cd5674d4f7c 2025-12-09T10:30:52.663940Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2183s 2025-12-09T10:30:52.664629Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:30:52.937277Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:28:20Z/1440c01bdf-7c9a-44e6-949d-db0adf3e68b9 2025-12-09T10:30:52.937785Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4922s 2025-12-09T10:30:52.938555Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:30:53.125769Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:28:20Z/141946804c-b424-45c9-93da-bc1b18745b8c 2025-12-09T10:30:53.125947Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6803s --- FAIL: TestProxyTracingOpenTelemetryProvider/http_exporter (152.99s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/http_exporter (152.99s) === RUN TestProxyTracingOpenTelemetryProvider/resource_detectors/primary-0 2025-12-09T10:30:53.230180Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/resource_detectors/primary-0]' === tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:119: retry.UntilSuccessOrFail: timeout while waiting after 47 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-09T10:33:23.230558Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/resource_detectors/primary-0] (2m30.000373321s)' === 2025-12-09T10:33:23.230680Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/resource_detectors/primary-0... 2025-12-09T10:33:23.230703Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/resource_detectors/primary-0... 2025-12-09T10:33:23.393369Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:30:53Z/152c37e6e6-6c11-4c7d-8278-1fa5c7a176d1 2025-12-09T10:33:23.393851Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1622s 2025-12-09T10:33:23.394473Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:33:23.530732Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:30:53Z/15dea1b2f4-ad65-4c04-8967-1378838ee95d 2025-12-09T10:33:23.530860Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2992s 2025-12-09T10:33:23.531809Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:33:23.656186Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:30:53Z/1524cf0e5e-911e-41dc-b16f-78c2656a7162 2025-12-09T10:33:23.656297Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4246s 2025-12-09T10:33:23.657352Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/resource_detectors/primary-0 (151.01s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/resource_detectors/primary-0 (151.01s) === RUN TestProxyTracingOpenTelemetryProvider/resource_detectors 2025-12-09T10:30:53.126335Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/resource_detectors]' === 2025-12-09T10:30:53.126685Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:33:24.238654Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/resource_detectors] (2m31.112310335s)' === 2025-12-09T10:33:24.238764Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/resource_detectors... 2025-12-09T10:33:24.238797Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/resource_detectors... 2025-12-09T10:33:24.468706Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:30:53Z/1532d7c634-0645-40c7-adf6-06561c210992 2025-12-09T10:33:24.469154Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2299s 2025-12-09T10:33:24.469699Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:33:24.595816Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:30:53Z/1563562bac-cd57-4b87-a4db-0ce3b483b6d0 2025-12-09T10:33:24.596225Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3569s 2025-12-09T10:33:24.597129Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:33:24.748269Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:30:53Z/158ddfb87f-ccf6-46a9-b730-77d13606eb9b 2025-12-09T10:33:24.748392Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5091s 2025-12-09T10:33:24.749268Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/resource_detectors (152.08s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/resource_detectors (152.08s) === RUN TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata/primary-0 2025-12-09T10:33:25.214198Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata/primary-0]' === tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:119: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-09T10:35:55.214671Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata/primary-0] (2m30.000470429s)' === 2025-12-09T10:35:55.214797Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata/primary-0... 2025-12-09T10:35:55.214816Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata/primary-0... 2025-12-09T10:35:55.366270Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:33:25Z/16d150965d-6a61-45a4-9e57-17f77bc1c41c 2025-12-09T10:35:55.366768Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1511s 2025-12-09T10:35:55.367328Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:35:55.500632Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:33:25Z/16141a53d6-3359-47a5-bd1b-f9ef9485f21f 2025-12-09T10:35:55.500752Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2851s 2025-12-09T10:35:55.501375Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:35:55.607634Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:33:25Z/168d53a338-6cb3-4f46-8177-1ef7279ca3f1 2025-12-09T10:35:55.607775Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3921s 2025-12-09T10:35:55.608473Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata/primary-0 (151.03s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata/primary-0 (151.03s) === RUN TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata 2025-12-09T10:33:25.203477Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata]' === 2025-12-09T10:35:56.240034Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata] (2m31.036551537s)' === 2025-12-09T10:35:56.240171Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata... 2025-12-09T10:35:56.240189Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata... 2025-12-09T10:35:56.413148Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:33:25Z/168a2ea18d-22fc-46da-aabf-f871a7aeb8ea 2025-12-09T10:35:56.413401Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.1730s 2025-12-09T10:35:56.414094Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:35:56.529894Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:33:25Z/161b4cb976-622d-459d-a1e6-ba0e8f681c4f 2025-12-09T10:35:56.530074Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2897s 2025-12-09T10:35:56.530770Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:35:56.671276Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:33:25Z/1629d8ff0b-6dd8-42c2-9c3e-91c1bf3779c6 2025-12-09T10:35:56.671657Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4312s 2025-12-09T10:35:56.672169Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata (152.11s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_initial_metadata (152.11s) === RUN TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth/primary-0 2025-12-09T10:35:57.320567Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth/primary-0]' === tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:120: Sending from cluster-0... tracing_test.go:119: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-09T10:38:27.321170Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth/primary-0] (2m30.000596428s)' === 2025-12-09T10:38:27.321298Z error tf === Dumping Namespace echo State for TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth/primary-0... 2025-12-09T10:38:27.321313Z error tf === Dumping Istio Deployment State for TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth/primary-0... 2025-12-09T10:38:27.492113Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:35:57Z/175fbf727e-6e9e-48bd-afd5-08f8d560e5c4 2025-12-09T10:38:27.492551Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1709s 2025-12-09T10:38:27.493061Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:38:27.588087Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:35:57Z/173cb107fd-e64c-4ef3-bfbd-589aeab8cf2f 2025-12-09T10:38:27.588223Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.2666s 2025-12-09T10:38:27.589155Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:38:27.714641Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:35:57Z/1725a77d3f-1195-45fc-94ed-db8f45f13cca 2025-12-09T10:38:27.714790Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3931s 2025-12-09T10:38:27.715676Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth/primary-0 (151.34s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth/primary-0 (151.34s) === RUN TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth 2025-12-09T10:35:57.308867Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth]' === 2025-12-09T10:38:28.659139Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth] (2m31.350267794s)' === --- FAIL: TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth (151.36s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider/grpc_exporter_with_auth (151.36s) === RUN TestProxyTracingOpenTelemetryProvider 2025-12-09T10:25:48.107779Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider]' === tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-09T10:33:13.117933Z error port forward failed: lost connection to pod 2025-12-09T10:33:13.118145Z error port forward failed: lost connection to pod 2025-12-09T10:33:13.118250Z error port forward failed: lost connection to pod 2025-12-09T10:33:13.180506Z warn pod: echo/client-cluster-0-v1-6bb9d855c5-2czlg port forward terminated 2025-12-09T10:33:13.180805Z warn pod: echo/server-v1-8b87894f7-2gn8v port forward terminated 2025-12-09T10:33:13.234529Z warn pod: echo/server-v1-8b87894f7-2gn8v port forward reconnect success 2025-12-09T10:33:13.240105Z warn pod: echo/client-cluster-0-v1-6bb9d855c5-2czlg port forward reconnect success tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig tracing_test.go:132: got traces [] from Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-09T10:38:28.668085Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestProxyTracingOpenTelemetryProvider] (12m40.560299904s)' === --- FAIL: TestProxyTracingOpenTelemetryProvider (760.56s) FAIL tests/integration/telemetry/tracing/otelcollector.TestProxyTracingOpenTelemetryProvider (760.56s) === RUN TestGatewayTracing/primary-0 2025-12-09T10:38:28.696391Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestGatewayTracing/primary-0]' === tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:164: Sending from cluster-0 ingress... tracing_test.go:162: retry.UntilSuccessOrFail: timeout while waiting after 50 attempts (last error: cannot get traces from zipkin: zipkin API returned status code: 404) 2025-12-09T10:40:58.696953Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestGatewayTracing/primary-0] (2m30.000557496s)' === --- FAIL: TestGatewayTracing/primary-0 (150.00s) FAIL tests/integration/telemetry/tracing/otelcollector.TestGatewayTracing/primary-0 (150.00s) === RUN TestGatewayTracing 2025-12-09T10:38:28.668282Z info tf === BEGIN: Test: 'telemetry_tracing_otelcollector[TestGatewayTracing]' === 2025-12-09T10:40:58.697074Z info tf === DONE (failed): Test: 'telemetry_tracing_otelcollector[TestGatewayTracing] (2m30.028790228s)' === --- FAIL: TestGatewayTracing (150.32s) FAIL tests/integration/telemetry/tracing/otelcollector.TestGatewayTracing (150.32s) 2025-12-09T10:40:58.983358Z info tf === FAILED: Test Run: 'telemetry_tracing_otelcollector' (exitCode: 1) === 2025-12-09T10:40:58.983415Z info tf === Suite "telemetry_tracing_otelcollector" run time: 15m33.888148477s === 2025-12-09T10:40:58.983432Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-otelcollector/artifacts/trace.yaml 2025-12-09T10:40:58.984045Z error tf === Dumping Namespace echo State for [suite(telemetry_tracing_otelcollector)]... 2025-12-09T10:40:58.984065Z error tf === Dumping Istio Deployment State for [suite(telemetry_tracing_otelcollector)]... 2025-12-09T10:40:59.169167Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:40:59Z/20a1232997-ea20-42b7-9a23-9f1a54f22430 2025-12-09T10:40:59.169616Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1852s 2025-12-09T10:40:59.170176Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:40:59.459215Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:40:59Z/2061bf948d-3b95-464a-ad6b-02718e8c8335 2025-12-09T10:40:59.459385Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4750s 2025-12-09T10:40:59.460248Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:40:59.622350Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T10:40:59Z/2070a937ff-ca62-4b55-a58d-35bb3679258a 2025-12-09T10:40:59.622613Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6381s 2025-12-09T10:40:59.623428Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T10:41:03.158850Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_tracing_otelcollector] === 2025-12-09T10:41:03.158957Z info tf === SUCCEEDED: Cleanup Istio in 98.251µs [Suite=telemetry_tracing_otelcollector] === FAIL tests/integration/telemetry/tracing/otelcollector DONE 13 tests, 13 failures in 938.132s exec: [go test -json -test.run=^TestProxyTracingOpenTelemetryProvider$/^grpc_exporter$/^primary-0$ -tags=integ -timeout 180m istio.io/istio/tests/integration/telemetry/tracing/otelcollector -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-otelcollector/artifacts] go test pid: 3477891 2025-12-09T10:41:14.480154Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T10:41:14.480213Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T10:41:14.512331Z info tf === Test Framework Settings === 2025-12-09T10:41:14.512431Z info tf TestID: telemetry_tracing_otelcollector RunID: 0ea2453b-e02c-424a-bf98-70e83c0beaa3 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-otelcollector/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T10:41:14.512437Z info tf =============================== 2025-12-09T10:41:14.512469Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-tracing-otelcollector/artifacts/telemetry-tracing-otelcollector- 2025-12-09T10:41:14.512516Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T10:41:14.512530Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T10:41:14.512551Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-09T10:41:14.512562Z info tf === BEGIN: Building clusters === 2025-12-09T10:41:14.517280Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-09T10:41:14.517289Z info tf === DONE: Building clusters === 2025-12-09T10:41:14.517311Z info tf === BEGIN: Setup: 'telemetry_tracing_otelcollector' === 2025-12-09T10:41:14.830216Z info tf === SUCCESS: context setup function === 2025-12-09T10:41:14.830301Z info tf === BEGIN: Deploy Istio [Suite=telemetry_tracing_otelcollector] === 2025-12-09T10:41:14.830317Z info tf === Istio Component Config === 2025-12-09T10:41:14.830366Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T10:41:14.830373Z info tf ================================ 2025-12-09T10:41:14.835350Z info tf skipping deployment as specified in the config 2025-12-09T10:41:14.835383Z info tf === SUCCEEDED: Deploy Istio in 5.072916ms [Suite=telemetry_tracing_otelcollector]=== 2025-12-09T10:41:14.835393Z info tf === BEGIN: Create namespace echo === 2025-12-09T10:41:14.843448Z info tf === SUCCEEDED: Create namespace echo in 8.041866ms === 2025-12-09T10:41:14.875599Z info tf === BEGIN: Deploy echo instances === 2025-12-09T10:41:14.917843Z info klog Waiting for caches to sync controller=echo 2025-12-09T10:41:14.918553Z info klog Waiting for caches to sync controller=echo 2025-12-09T10:41:15.018347Z info klog Caches are synced controller=echo 2025-12-09T10:41:15.018699Z info klog Caches are synced controller=echo