exec: [go test -json -tags=integ -timeout 180m ./tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 755389 2025-08-04T19:42:40.039036Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:42:40.039104Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:42:40.074750Z info tf === Test Framework Settings === 2025-08-04T19:42:40.074844Z info tf TestID: pilot RunID: 66bd013f-9aec-45af-937c-656be4ff4af6 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:42:40.074853Z info tf =============================== 2025-08-04T19:42:40.077448Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be 2025-08-04T19:42:40.077546Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:42:40.077564Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:42:40.078588Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:42:40.078601Z info tf === BEGIN: Building clusters === 2025-08-04T19:42:40.085649Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:42:40.085704Z info tf === DONE: Building clusters === 2025-08-04T19:42:40.085724Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:42:40.086082Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:42:40.086097Z info tf === Istio Component Config === 2025-08-04T19:42:40.086162Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:42:40.086173Z info tf ================================ 2025-08-04T19:42:40.089821Z info tf skipping deployment as specified in the config 2025-08-04T19:42:40.089843Z info tf === SUCCEEDED: Deploy Istio in 3.755375ms [Suite=pilot]=== 2025-08-04T19:42:40.089958Z info tf === BEGIN: Create namespace external === 2025-08-04T19:42:40.089961Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:42:40.125399Z info tf === SUCCEEDED: Create namespace external in 35.468197ms === 2025-08-04T19:42:40.125430Z info tf === SUCCEEDED: Create namespace echo in 35.496678ms === 2025-08-04T19:42:40.242671Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:42:41.784713Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:41.804524Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:41.885240Z info klog Caches are synced controller=echo 2025-08-04T19:42:41.904908Z info klog Caches are synced controller=echo 2025-08-04T19:42:41.922924Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:41.935921Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:41.969253Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:41.981630Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:42.012728Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:42.020242Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:42.023092Z info klog Caches are synced controller=echo 2025-08-04T19:42:42.036972Z info klog Caches are synced controller=echo 2025-08-04T19:42:42.069677Z info klog Caches are synced controller=echo 2025-08-04T19:42:42.079201Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:42:42.081781Z info klog Caches are synced controller=echo 2025-08-04T19:42:42.112898Z info klog Caches are synced controller=echo 2025-08-04T19:42:42.120331Z info klog Caches are synced controller=echo 2025-08-04T19:42:42.179828Z info klog Caches are synced controller=echo 2025-08-04T19:42:53.434148Z info tf === SUCCEEDED: Deploy echo instances in 13.191481009s === 2025-08-04T19:42:53.688311Z info tf === DONE: Setup: 'pilot' (13.602569789s) === 2025-08-04T19:42:53.688380Z info tf === BEGIN: Test Run: 'pilot' === PASS tests/integration/pilot.TestEmptyCluster (1.97s) PASS tests/integration/pilot.TestFileOnly (0.07s) PASS tests/integration/pilot.TestDirectory (0.02s) PASS tests/integration/pilot.TestInvalidFileError (0.02s) === RUN TestJsonInputFile 2025-08-04T19:42:55.770193Z info tf === BEGIN: Test: 'pilot[TestJsonInputFile]' === 2025-08-04T19:42:55.770212Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:42:55.778735Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 8.518532ms === analyze_test.go:178: apply: patch: gateways.networking.istio.io "httpbin-gateway-bogus" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:42:55.784831Z info tf === DONE (failed): Test: 'pilot[TestJsonInputFile] (14.635786ms)' === 2025-08-04T19:42:55.784868Z error tf === Dumping Namespace echo State for TestJsonInputFile... 2025-08-04T19:42:55.784888Z error tf === Dumping Istio Deployment State for TestJsonInputFile... 2025-08-04T19:42:55.784901Z error tf === Dumping Namespace external State for TestJsonInputFile... 2025-08-04T19:42:56.149237Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5628b0efdc-1c4a-4fa1-a2b8-de370da602d4 2025-08-04T19:42:56.149343Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3642s 2025-08-04T19:42:56.150112Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:56.757488Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56d25d2e97-f0de-4f27-893f-81f08edc646b 2025-08-04T19:42:56.757832Z info tf istioctl ([x internal-debug --all configz]): completed after 0.9726s 2025-08-04T19:42:56.758551Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:56.858804Z error tf === Dumping Namespace istioctl-analyze State for TestJsonInputFile... --- FAIL: TestJsonInputFile (1.10s) FAIL tests/integration/pilot.TestJsonInputFile (1.10s) === RUN TestJsonOutput/no_other_output_except_analysis_json_output 2025-08-04T19:42:56.883173Z info tf === BEGIN: Test: 'pilot[TestJsonOutput/no_other_output_except_analysis_json_output]' === analyze_test.go:201: apply: patch: gateways.networking.istio.io "httpbin-gateway-bogus" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:42:56.891118Z info tf === DONE (failed): Test: 'pilot[TestJsonOutput/no_other_output_except_analysis_json_output] (7.93815ms)' === 2025-08-04T19:42:56.891230Z error tf === Dumping Namespace echo State for TestJsonOutput/no_other_output_except_analysis_json_output... 2025-08-04T19:42:56.891261Z error tf === Dumping Namespace external State for TestJsonOutput/no_other_output_except_analysis_json_output... 2025-08-04T19:42:56.891271Z error tf === Dumping Istio Deployment State for TestJsonOutput/no_other_output_except_analysis_json_output... 2025-08-04T19:42:56.950797Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5615631a58-8764-4cf1-a06a-46eca01e32ba 2025-08-04T19:42:56.950978Z info tf istioctl ([x internal-debug --all clusterz]): completed after 1.1658s 2025-08-04T19:42:56.951614Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:57.215552Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56c1c48225-2bbf-4518-974a-6afece70e354 2025-08-04T19:42:57.215728Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3239s 2025-08-04T19:42:57.216665Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:57.365740Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/561decd976-da90-476e-8c00-af2c6e701d8e 2025-08-04T19:42:57.365953Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4741s 2025-08-04T19:42:57.366994Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestJsonOutput/no_other_output_except_analysis_json_output (1.20s) FAIL tests/integration/pilot.TestJsonOutput/no_other_output_except_analysis_json_output (1.20s) PASS tests/integration/pilot.TestJsonOutput/invalid_file_does_not_output_error_in_stdout (0.11s) === RUN TestJsonOutput 2025-08-04T19:42:56.874262Z info tf === BEGIN: Test: 'pilot[TestJsonOutput]' === 2025-08-04T19:42:56.874335Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:42:56.882550Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 8.195749ms === 2025-08-04T19:42:58.190252Z info tf === DONE (failed): Test: 'pilot[TestJsonOutput] (1.315990921s)' === 2025-08-04T19:42:58.190309Z error tf === Dumping Namespace echo State for TestJsonOutput... 2025-08-04T19:42:58.190326Z error tf === Dumping Namespace external State for TestJsonOutput... 2025-08-04T19:42:58.190343Z error tf === Dumping Istio Deployment State for TestJsonOutput... 2025-08-04T19:42:58.598209Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5660d82e14-291a-4b88-b9f4-8d5226654ad7 2025-08-04T19:42:58.598379Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4077s 2025-08-04T19:42:58.598920Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:58.910444Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56a9eb5f8c-d1fc-439b-bcd1-ee47cac594a1 2025-08-04T19:42:58.910578Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.7199s 2025-08-04T19:42:58.911460Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:59.102757Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56c0ed80df-59f0-451a-8612-ed72d5150a41 2025-08-04T19:42:59.102885Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.9121s 2025-08-04T19:42:59.103469Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:59.847142Z error tf === Dumping Namespace istioctl-analyze State for TestJsonOutput... --- FAIL: TestJsonOutput (2.99s) FAIL tests/integration/pilot.TestJsonOutput (2.99s) === RUN TestKubeOnly 2025-08-04T19:42:59.864513Z info tf === BEGIN: Test: 'pilot[TestKubeOnly]' === 2025-08-04T19:42:59.864590Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:42:59.884875Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 20.277939ms === analyze_test.go:228: apply: patch: gateways.networking.istio.io "httpbin-gateway-bogus" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:42:59.889451Z info tf === DONE (failed): Test: 'pilot[TestKubeOnly] (24.936323ms)' === 2025-08-04T19:42:59.889515Z error tf === Dumping Namespace echo State for TestKubeOnly... 2025-08-04T19:42:59.889546Z error tf === Dumping Istio Deployment State for TestKubeOnly... 2025-08-04T19:42:59.889555Z error tf === Dumping Namespace external State for TestKubeOnly... 2025-08-04T19:43:00.198851Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56ede57931-9adb-48b9-bb73-1a4b0e1617d9 2025-08-04T19:43:00.199033Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3093s 2025-08-04T19:43:00.199875Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:00.349161Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56907db301-456f-42f0-a192-01ba2356a68e 2025-08-04T19:43:00.349351Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4595s 2025-08-04T19:43:00.350190Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:00.511868Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5631960048-bd09-4335-ae8e-56efcace778d 2025-08-04T19:43:00.512025Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6222s 2025-08-04T19:43:00.512852Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:00.942855Z error tf === Dumping Namespace istioctl-analyze State for TestKubeOnly... --- FAIL: TestKubeOnly (1.09s) FAIL tests/integration/pilot.TestKubeOnly (1.09s) === RUN TestFileAndKubeCombined 2025-08-04T19:43:00.956572Z info tf === BEGIN: Test: 'pilot[TestFileAndKubeCombined]' === 2025-08-04T19:43:00.956637Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:43:00.982927Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 26.280591ms === analyze_test.go:252: apply: patch: virtualservices.networking.istio.io "reviews" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:43:01.027664Z info tf === DONE (failed): Test: 'pilot[TestFileAndKubeCombined] (71.0889ms)' === 2025-08-04T19:43:01.027725Z error tf === Dumping Namespace echo State for TestFileAndKubeCombined... 2025-08-04T19:43:01.027792Z error tf === Dumping Namespace external State for TestFileAndKubeCombined... 2025-08-04T19:43:01.027771Z error tf === Dumping Istio Deployment State for TestFileAndKubeCombined... 2025-08-04T19:43:02.256643Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56659ddd60-306d-47a0-a498-dccc1c6014bf 2025-08-04T19:43:02.256907Z info tf istioctl ([x internal-debug --all configz]): completed after 1.2287s 2025-08-04T19:43:02.257731Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:02.603411Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/565241af20-8822-45ce-a586-7b233a4dc321 2025-08-04T19:43:02.603645Z info tf istioctl ([x internal-debug --all mcsz]): completed after 1.5754s 2025-08-04T19:43:02.604429Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:02.758046Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56982d1a5a-e6b2-405d-b7d2-fca1f1935cd1 2025-08-04T19:43:02.758201Z info tf istioctl ([x internal-debug --all clusterz]): completed after 1.7300s 2025-08-04T19:43:02.758921Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:02.852145Z error tf === Dumping Namespace istioctl-analyze State for TestFileAndKubeCombined... --- FAIL: TestFileAndKubeCombined (1.91s) FAIL tests/integration/pilot.TestFileAndKubeCombined (1.91s) PASS tests/integration/pilot.TestAllNamespaces (1.47s) PASS tests/integration/pilot.TestErrorLine (0.85s) PASS tests/integration/pilot.TestDNSAutoAllocation (8.34s) === RUN TestGatewayConformance 2025-08-04T19:43:13.522642Z info tf === BEGIN: Test: 'pilot[TestGatewayConformance]' === gateway_conformance_test.go:158: expected no error but got: no Gateway API CRDs with the proper annotations found in the cluster 2025-08-04T19:43:14.494077Z info tf === DONE (failed): Test: 'pilot[TestGatewayConformance] (971.429989ms)' === 2025-08-04T19:43:14.494160Z error tf === Dumping Namespace echo State for TestGatewayConformance... 2025-08-04T19:43:14.494182Z error tf === Dumping Istio Deployment State for TestGatewayConformance... 2025-08-04T19:43:14.494193Z error tf === Dumping Namespace external State for TestGatewayConformance... 2025-08-04T19:43:14.876837Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/618cc681ce-24ca-4e96-952f-7fbb1d51c076 2025-08-04T19:43:14.877187Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3826s 2025-08-04T19:43:14.877731Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:15.010361Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/616b02f135-12f3-40cb-8da1-86f319ce18db 2025-08-04T19:43:15.010455Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5159s 2025-08-04T19:43:15.011177Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:15.179824Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61d2099914-b0f0-4cf6-8e30-0a34d635a6c1 2025-08-04T19:43:15.179956Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6854s 2025-08-04T19:43:15.180791Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:15.648986Z error tf === Dumping Namespace gateway-conformance-infra State for TestGatewayConformance... 2025-08-04T19:43:15.655919Z error tf === Dumping Namespace gateway-conformance-mesh State for TestGatewayConformance... 2025-08-04T19:43:15.661477Z error tf === Dumping Namespace gateway-conformance-mesh-consumer State for TestGatewayConformance... 2025-08-04T19:43:15.677348Z error tf === Dumping Namespace gateway-conformance-app-backend State for TestGatewayConformance... 2025-08-04T19:43:15.683494Z error tf === Dumping Namespace gateway-conformance-web-backend State for TestGatewayConformance... --- FAIL: TestGatewayConformance (2.18s) FAIL tests/integration/pilot.TestGatewayConformance (2.18s) === RUN TestGateway/unmanaged 2025-08-04T19:43:15.700672Z info tf === BEGIN: Test: 'pilot[TestGateway/unmanaged]' === gateway_test.go:621: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/unmanaged/_test_context/GatewayClass-Gateway.3275374411.yaml] to ns in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:15.769170Z info tf === DONE (failed): Test: 'pilot[TestGateway/unmanaged] (68.490849ms)' === 2025-08-04T19:43:15.769354Z error tf === Dumping Namespace echo State for TestGateway/unmanaged... 2025-08-04T19:43:15.769378Z error tf === Dumping Istio Deployment State for TestGateway/unmanaged... 2025-08-04T19:43:15.769381Z error tf === Dumping Namespace external State for TestGateway/unmanaged... 2025-08-04T19:43:16.055904Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/615068c52d-b814-412f-a3af-da7fd8c3dcce 2025-08-04T19:43:16.056097Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2863s 2025-08-04T19:43:16.056722Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:16.241304Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/617421ef11-3ff0-4dc1-bffc-7941cb99dc67 2025-08-04T19:43:16.241482Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4716s 2025-08-04T19:43:16.242176Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:16.357754Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61e4dde684-f532-411e-9085-79b47657b02d 2025-08-04T19:43:16.357886Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5880s 2025-08-04T19:43:16.358503Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:16.859925Z error tf === Dumping Namespace istio-system State for TestGateway/unmanaged... --- FAIL: TestGateway/unmanaged (2.41s) FAIL tests/integration/pilot.TestGateway/unmanaged (2.41s) === RUN TestGateway/managed 2025-08-04T19:43:18.106295Z info tf === BEGIN: Test: 'pilot[TestGateway/managed]' === gateway_test.go:189: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/managed/_test_context/Gateway-HTTPRoute.2562765835.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:18.109302Z info tf === DONE (failed): Test: 'pilot[TestGateway/managed] (3.000534ms)' === 2025-08-04T19:43:18.109415Z error tf === Dumping Namespace echo State for TestGateway/managed... 2025-08-04T19:43:18.109426Z error tf === Dumping Istio Deployment State for TestGateway/managed... 2025-08-04T19:43:18.109432Z error tf === Dumping Namespace external State for TestGateway/managed... 2025-08-04T19:43:18.384867Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/6153247739-910a-4292-be24-f3810028dd68 2025-08-04T19:43:18.385039Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2753s 2025-08-04T19:43:18.385869Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:18.548595Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61106b1150-1bbe-4a37-a866-e09c53a95c5d 2025-08-04T19:43:18.548730Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4389s 2025-08-04T19:43:18.549512Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:18.716338Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61ff6b0723-2f45-4bf4-9e6a-9cff434ef84f 2025-08-04T19:43:18.716515Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6067s 2025-08-04T19:43:18.717306Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway/managed (0.89s) FAIL tests/integration/pilot.TestGateway/managed (0.89s) === RUN TestGateway/tagged/gateway-connectivity-tagged-tag 2025-08-04T19:43:19.289413Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-tag]' === gateway_test.go:361: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/tagged/gateway-connectivity-tagged-tag/_test_context/Gateway-HTTPRoute.3834686547.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:19.292987Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-tag] (3.570424ms)' === 2025-08-04T19:43:19.293036Z error tf === Dumping Namespace echo State for TestGateway/tagged/gateway-connectivity-tagged-tag... 2025-08-04T19:43:19.293040Z error tf === Dumping Istio Deployment State for TestGateway/tagged/gateway-connectivity-tagged-tag... 2025-08-04T19:43:19.293078Z error tf === Dumping Namespace external State for TestGateway/tagged/gateway-connectivity-tagged-tag... 2025-08-04T19:43:19.641187Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:19Z/6275c361b9-15e4-4110-82ce-9cac28acbfd0 2025-08-04T19:43:19.641375Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3482s 2025-08-04T19:43:19.642262Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:19.798330Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:19Z/62533de74f-6804-4849-8a43-0b7d476598cd 2025-08-04T19:43:19.798440Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5052s 2025-08-04T19:43:19.799292Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:19.945173Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:19Z/620de40a22-1f0d-45d7-818e-e216fbe9e7fe 2025-08-04T19:43:19.945272Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6520s 2025-08-04T19:43:19.945919Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway/tagged/gateway-connectivity-tagged-tag (1.05s) FAIL tests/integration/pilot.TestGateway/tagged/gateway-connectivity-tagged-tag (1.05s) === RUN TestGateway/tagged/gateway-connectivity-tagged-badtag 2025-08-04T19:43:20.339946Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-badtag]' === gateway_test.go:361: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/tagged/gateway-connectivity-tagged-badtag/_test_context/Gateway-HTTPRoute.773132747.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:20.344660Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-badtag] (4.712782ms)' === --- FAIL: TestGateway/tagged/gateway-connectivity-tagged-badtag (0.01s) FAIL tests/integration/pilot.TestGateway/tagged/gateway-connectivity-tagged-badtag (0.01s) === RUN TestGateway/tagged 2025-08-04T19:43:18.993754Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged]' === 2025-08-04T19:43:19.158450Z info cluster "" kube client started 2025-08-04T19:43:19.259072Z info kube Starting Pilot K8S CRD controller controller=analysis-controller 2025-08-04T19:43:19.259168Z info kube Pilot K8S CRD controller synced in 90.414µs controller=analysis-controller 2025-08-04T19:43:19.259080Z info kube Starting Pilot K8S CRD controller controller=analysis-controller 2025-08-04T19:43:19.259206Z info kube Pilot K8S CRD controller synced in 125.545µs controller=analysis-controller 2025-08-04T19:43:19.288859Z info tf istioctl ([tag set tag --revision default]): completed after 0.2950s 2025-08-04T19:43:20.344721Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged] (1.350966507s)' === --- FAIL: TestGateway/tagged (1.35s) FAIL tests/integration/pilot.TestGateway/tagged (1.35s) === RUN TestGateway/managed-owner 2025-08-04T19:43:20.345006Z info tf === BEGIN: Test: 'pilot[TestGateway/managed-owner]' === 2025-08-04T19:43:20.416403Z info tf Checking pods ready... 2025-08-04T19:43:20.416440Z info tf Checking pods ready... 2025-08-04T19:43:20.459883Z info tf Failed retrieving pods: no matching pod found for selectors: [gateway.networking.k8s.io/gateway-name=managed-owner] 2025-08-04T19:43:20.660575Z info tf Checking pods ready... 2025-08-04T19:43:20.660649Z info tf Checking pods ready... 2025-08-04T19:43:20.667083Z info tf Failed retrieving pods: no matching pod found for selectors: [gateway.networking.k8s.io/gateway-name=managed-owner] 2025-08-04T19:43:21.067741Z info tf Checking pods ready... 2025-08-04T19:43:21.067798Z info tf Checking pods ready... 2025-08-04T19:43:21.073736Z info tf Failed retrieving pods: no matching pod found for selectors: [gateway.networking.k8s.io/gateway-name=managed-owner] 2025-08-04T19:43:21.874848Z info tf Checking pods ready... 2025-08-04T19:43:21.874918Z info tf Checking pods ready... 2025-08-04T19:43:21.892616Z info tf [ 0] managed-owner-istio-5cb6f544b4-kns4p Pending (Pending) 2025-08-04T19:43:23.492695Z info tf Checking pods ready... 2025-08-04T19:43:23.492825Z info tf Checking pods ready... 2025-08-04T19:43:23.499883Z info tf [ 0] managed-owner-istio-5cb6f544b4-kns4p Pending (Pending) 2025-08-04T19:43:26.700141Z info tf Checking pods ready... 2025-08-04T19:43:26.700262Z info tf Checking pods ready... 2025-08-04T19:43:26.709422Z info tf [ 0] managed-owner-istio-5cb6f544b4-kns4p Running (Ready) gateway_test.go:117: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/managed-owner/_test_context/Gateway.3102234163.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:26.713408Z info tf === DONE (failed): Test: 'pilot[TestGateway/managed-owner] (6.36839516s)' === --- FAIL: TestGateway/managed-owner (6.44s) FAIL tests/integration/pilot.TestGateway/managed-owner (6.44s) === RUN TestGateway/status 2025-08-04T19:43:26.788177Z info tf === BEGIN: Test: 'pilot[TestGateway/status]' === 2025-08-04T19:43:52.757375Z error port forward failed: lost connection to pod 2025-08-04T19:43:52.795746Z error port forward failed: lost connection to pod 2025-08-04T19:43:52.877614Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:43:52.885360Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:43:52.953379Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:43:52.956314Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success gateway_test.go:741: retry.UntilSuccessOrFail: timeout while waiting after 188 attempts (last error: failed to find accepted condition: {Type: Status: ObservedGeneration:0 LastTransitionTime:0001-01-01 00:00:00 +0000 UTC Reason: Message:}) 2025-08-04T19:43:56.788965Z info tf === DONE (failed): Test: 'pilot[TestGateway/status] (30.000786338s)' === --- FAIL: TestGateway/status (30.00s) FAIL tests/integration/pilot.TestGateway/status (30.00s) === RUN TestGateway/managed-short-name 2025-08-04T19:43:56.789379Z info tf === BEGIN: Test: 'pilot[TestGateway/managed-short-name]' === gateway_test.go:402: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/managed-short-name/_test_context/Gateway-HTTPRoute.3495175617.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:56.792464Z info tf === DONE (failed): Test: 'pilot[TestGateway/managed-short-name] (3.07992ms)' === --- FAIL: TestGateway/managed-short-name (0.00s) FAIL tests/integration/pilot.TestGateway/managed-short-name (0.00s) === RUN TestGateway 2025-08-04T19:43:15.700307Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T19:43:56.792522Z info tf === DONE (failed): Test: 'pilot[TestGateway] (41.092215009s)' === --- FAIL: TestGateway (41.09s) FAIL tests/integration/pilot.TestGateway (41.09s) PASS tests/integration/pilot.TestGatewayReadinessProbes/gateway-readiness-probe-172.30.239.166 (0.01s) PASS tests/integration/pilot.TestGatewayReadinessProbes (0.03s) PASS tests/integration/pilot.TestGatewayMetricsEndpoints/gateway-metrics-endpoints-172.23.0.83 (0.03s) PASS tests/integration/pilot.TestGatewayMetricsEndpoints (0.04s) PASS tests/integration/pilot.TestGRPCProbe/rewrite-ready (8.23s) PASS tests/integration/pilot.TestGRPCProbe (8.29s) PASS tests/integration/pilot.TestXFFGateway/a (0.32s) PASS tests/integration/pilot.TestXFFGateway (3.64s) === RUN TestProxyProtocolTCPGateway/filter/a 2025-08-04T19:44:08.843111Z info tf === BEGIN: Test: 'pilot[TestProxyProtocolTCPGateway/filter/a]' === traffic.go:245: failed calling naked (cluster=cluster-0)->'tcp://custom-gateway.custom-gateway.svc.cluster.local:80': call failed from naked (cluster=cluster-0) to tcp://custom-gateway.custom-gateway.svc.cluster.local:80 (using tcp): no responses received 2025-08-04T19:44:38.914866Z info tf === DONE (failed): Test: 'pilot[TestProxyProtocolTCPGateway/filter/a] (30.071752086s)' === --- FAIL: TestProxyProtocolTCPGateway/filter/a (30.09s) FAIL tests/integration/pilot.TestProxyProtocolTCPGateway/filter/a (30.09s) === RUN TestProxyProtocolTCPGateway/filter 2025-08-04T19:44:08.842251Z info tf === BEGIN: Test: 'pilot[TestProxyProtocolTCPGateway/filter]' === 2025-08-04T19:44:38.931786Z info tf === DONE (failed): Test: 'pilot[TestProxyProtocolTCPGateway/filter] (30.08952902s)' === --- FAIL: TestProxyProtocolTCPGateway/filter (30.09s) FAIL tests/integration/pilot.TestProxyProtocolTCPGateway/filter (30.09s) === RUN TestProxyProtocolTCPGateway 2025-08-04T19:44:08.791484Z info tf === BEGIN: Test: 'pilot[TestProxyProtocolTCPGateway]' === 2025-08-04T19:44:08.791526Z info tf === BEGIN: Create namespace custom-gateway === 2025-08-04T19:44:08.799170Z info tf === SUCCEEDED: Create namespace custom-gateway in 7.6347ms === 2025-08-04T19:44:08.826410Z info tf Checking pods ready... 2025-08-04T19:44:08.841730Z info tf [ 0] custom-gateway-6c777c7db9-b929d Running (Ready) 2025-08-04T19:44:38.931853Z info tf === DONE (failed): Test: 'pilot[TestProxyProtocolTCPGateway] (30.140369305s)' === --- FAIL: TestProxyProtocolTCPGateway (30.15s) FAIL tests/integration/pilot.TestProxyProtocolTCPGateway (30.15s) PASS tests/integration/pilot.TestProxyHeaders (8.48s) === RUN TestXfccHeaders 2025-08-04T19:44:47.419491Z info tf === BEGIN: Test: 'pilot[TestXfccHeaders]' === 2025-08-04T19:44:47.419529Z info tf === BEGIN: Create namespace proxy-headers === 2025-08-04T19:44:47.427835Z info tf === SUCCEEDED: Create namespace proxy-headers in 8.295725ms === 2025-08-04T19:44:47.450696Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:44:47.500253Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:44:47.600761Z info klog Caches are synced controller=echo 2025-08-04T19:44:47.600864Z info tf === SUCCEEDED: Deploy echo instances in 150.164213ms === headers_test.go:238: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestXfccHeaders/_test_context/ServiceEntry.2663853934.yaml] to ns proxy-headers in cluster cluster-0: apply: patch: serviceentries.networking.istio.io "external-service" is forbidden: unable to create new content in namespace proxy-headers because it is being terminated 2025-08-04T19:44:47.646723Z info tf === DONE (failed): Test: 'pilot[TestXfccHeaders] (227.225623ms)' === --- FAIL: TestXfccHeaders (0.23s) FAIL tests/integration/pilot.TestXfccHeaders (0.23s) PASS tests/integration/pilot.TestIngress/from_primary-0/http (0.60s) PASS tests/integration/pilot.TestIngress/from_primary-0/http-prefix-matches-subpath (0.05s) PASS tests/integration/pilot.TestIngress/from_primary-0/http-prefix-matches-without-trailing-backslash (0.04s) PASS tests/integration/pilot.TestIngress/from_primary-0/http-prefix-matches-trailing-blackslash (0.05s) PASS tests/integration/pilot.TestIngress/from_primary-0/http-prefix-should-not-match-path-continuation (0.57s) PASS tests/integration/pilot.TestIngress/from_primary-0/http-root-prefix-should-match-random-path (0.55s) PASS tests/integration/pilot.TestIngress/from_primary-0/https-foo (0.07s) PASS tests/integration/pilot.TestIngress/from_primary-0/https-bar (0.09s) PASS tests/integration/pilot.TestIngress/from_primary-0/https-namedport (0.07s) PASS tests/integration/pilot.TestIngress/from_primary-0 (2.09s) PASS tests/integration/pilot.TestIngress/status (0.03s) PASS tests/integration/pilot.TestIngress/initial_state (0.01s) PASS tests/integration/pilot.TestIngress/update-class-not-istio (0.16s) PASS tests/integration/pilot.TestIngress/update-class-istio (0.16s) PASS tests/integration/pilot.TestIngress/update-path (0.17s) PASS tests/integration/pilot.TestIngress (2.80s) PASS tests/integration/pilot.TestCustomGateway/minimal (4.93s) PASS tests/integration/pilot.TestCustomGateway/minimal-delay-create-gateway-svc (0.10s) PASS tests/integration/pilot.TestCustomGateway (5.03s) PASS tests/integration/pilot.TestVersion (0.20s) PASS tests/integration/pilot.TestXdsVersion (0.13s) PASS tests/integration/pilot.TestDescribe (5.12s) PASS tests/integration/pilot.TestProxyConfig (2.31s) PASS tests/integration/pilot.TestProxyStatus (4.96s) PASS tests/integration/pilot.TestAuthZCheck/ingressgateway (0.80s) PASS tests/integration/pilot.TestAuthZCheck/workload (0.72s) PASS tests/integration/pilot.TestAuthZCheck (1.64s) PASS tests/integration/pilot.TestKubeInject (0.10s) PASS tests/integration/pilot.TestLabelChanges (1.35s) PASS tests/integration/pilot.TestLocality/Prioritized/CDS (0.70s) PASS tests/integration/pilot.TestLocality/Prioritized/EDS (0.30s) PASS tests/integration/pilot.TestLocality/Failover/CDS (0.38s) PASS tests/integration/pilot.TestLocality/Failover/EDS (0.62s) PASS tests/integration/pilot.TestLocality/FailoverPriority/EDS (0.39s) PASS tests/integration/pilot.TestLocality/Distribute/CDS (0.24s) PASS tests/integration/pilot.TestLocality/Distribute/EDS (0.37s) PASS tests/integration/pilot.TestLocality/TrafficDistribution/EDS (0.50s) PASS tests/integration/pilot.TestLocality (3.49s) PASS tests/integration/pilot.TestMirroring/mirror-percent-absent/from_primary-0/HTTP (1.01s) PASS tests/integration/pilot.TestMirroring/mirror-percent-absent/from_primary-0/GRPC (0.99s) PASS tests/integration/pilot.TestMirroring/mirror-percent-absent/from_primary-0 (2.00s) PASS tests/integration/pilot.TestMirroring/mirror-percent-absent (2.02s) PASS tests/integration/pilot.TestMirroring/mirror-50/from_primary-0/HTTP (1.37s) PASS tests/integration/pilot.TestMirroring/mirror-50/from_primary-0/GRPC (1.22s) PASS tests/integration/pilot.TestMirroring/mirror-50/from_primary-0 (2.59s) PASS tests/integration/pilot.TestMirroring/mirror-50 (2.61s) PASS tests/integration/pilot.TestMirroring/mirror-10/from_primary-0/HTTP (1.82s) PASS tests/integration/pilot.TestMirroring/mirror-10/from_primary-0/GRPC (1.55s) PASS tests/integration/pilot.TestMirroring/mirror-10/from_primary-0 (3.38s) PASS tests/integration/pilot.TestMirroring/mirror-10 (3.41s) PASS tests/integration/pilot.TestMirroring/mirror-0/from_primary-0/HTTP (2.01s) PASS tests/integration/pilot.TestMirroring/mirror-0/from_primary-0/GRPC (1.57s) PASS tests/integration/pilot.TestMirroring/mirror-0/from_primary-0 (3.58s) PASS tests/integration/pilot.TestMirroring/mirror-0 (3.60s) PASS tests/integration/pilot.TestMirroring (11.64s) PASS tests/integration/pilot.TestMirroringExternalService/mirror-external/from_primary-0/HTTP (1.86s) PASS tests/integration/pilot.TestMirroringExternalService/mirror-external/from_primary-0/GRPC (2.03s) PASS tests/integration/pilot.TestMirroringExternalService/mirror-external/from_primary-0 (3.89s) PASS tests/integration/pilot.TestMirroringExternalService/mirror-external (3.94s) PASS tests/integration/pilot.TestMirroringExternalService (3.94s) PASS tests/integration/pilot.TestPreserveHTTPHeaderCaseConfiguration (10.38s) PASS tests/integration/pilot.TestPreserveHTTPHeaderCase (0.25s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_nested_claim_using_claim_to_header:200/to_b (0.74s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_nested_claim_using_claim_to_header:200 (0.82s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_nested_claim_and_single_claim_using_claim_to_header:200/to_b (0.34s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_nested_claim_and_single_claim_using_claim_to_header:200 (0.44s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_wrong_claim_and_added_header:404/to_b (0.25s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_wrong_claim_and_added_header:404 (0.32s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_nested_claims:200/to_b (0.36s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_nested_claims:200 (0.44s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_single_claim:200/to_b (0.08s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_with_single_claim:200 (0.15s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_multiple_claims_with_regex:200/to_b (0.33s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_multiple_claims_with_regex:200 (0.41s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_multiple_claims:200/to_b (0.34s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_multiple_claims:200 (0.43s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_without_claim:200/to_b (0.34s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_without_claim:200 (0.65s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_without_claim:404/to_b (0.27s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_without_claim:404 (0.37s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_both_with_and_without_claims_with_regex:200/to_b (0.37s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/matched_both_with_and_without_claims_with_regex:200 (0.46s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_multiple_claims:404/to_b (0.25s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_multiple_claims:404 (0.36s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_token:404/to_b (0.39s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_token:404 (0.51s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_invalid_token:401/to_b (0.10s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_invalid_token:401 (0.22s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_no_token:404/to_b (0.07s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_no_token:404 (0.16s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_no_token_but_same_header:404/to_b (0.25s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_no_token_but_same_header:404 (0.35s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_no_request_authentication:404/to_b (0.23s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/unmatched_with_no_request_authentication:404 (0.33s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_nested_claims:200/to_b (0.32s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_nested_claims:200 (0.43s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_single_claim:200/to_b (0.47s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_single_claim:200 (0.57s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_multiple_claims_with_regex:200/to_b (0.32s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_multiple_claims_with_regex:200 (0.46s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_multiple_claims:200/to_b (0.32s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_multiple_claims:200 (0.49s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_without_claim:200/to_b (0.28s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_without_claim:200 (0.45s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_without_claim:404/to_b (0.23s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_without_claim:404 (0.33s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_both_with_and_without_claims_with_regex:200/to_b (0.26s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_both_with_and_without_claims_with_regex:200 (0.33s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_multiple_claims:404/to_b (0.53s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_multiple_claims:404 (0.75s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_token:404/to_b (0.32s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_token:404 (0.43s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_invalid_token:401/to_b (0.30s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_invalid_token:401 (0.44s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_no_token:404/to_b (0.11s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_no_token:404 (0.23s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_no_token_but_same_header:404/to_b (0.24s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_no_token_but_same_header:404 (0.34s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_no_request_authentication:404/to_b (0.23s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_no_request_authentication:404 (0.31s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_simple_collision-resistant_claim_name:200/to_b (0.25s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_simple_collision-resistant_claim_name:200 (0.33s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_simple_collision-resistant_claim_name:404/to_b (0.53s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_simple_collision-resistant_claim_name:404 (0.75s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_nested_collision-resistant_claim_name:200/to_b (1.21s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_matched_with_nested_collision-resistant_claim_name:200 (1.40s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_nested_collision-resistant_claim_name:404/to_b (0.24s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route/usage2:_unmatched_with_nested_collision-resistant_claim_name:404 (0.33s) PASS tests/integration/pilot.TestTraffic/jwt-claim-route (14.77s) PASS tests/integration/pilot.TestTraffic/virtualservice/added_header/a/to_b (0.46s) PASS tests/integration/pilot.TestTraffic/virtualservice/added_header/a (0.47s) PASS tests/integration/pilot.TestTraffic/virtualservice/added_header (0.53s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_header/a/to_b (0.21s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_header/a (0.22s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_header (0.28s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_authority_header/a/to_b (0.22s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_authority_header/a (0.23s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_authority_header (0.29s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_destination/a/to_b (0.05s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_destination/a (0.05s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_destination (0.12s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_authority_header_in_destination/a/to_b (0.06s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_authority_header_in_destination/a (0.07s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_authority_header_in_destination (0.13s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_route_and_destination/a/to_b (0.24s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_route_and_destination/a (0.24s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_route_and_destination (0.33s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_route_and_multi_destination/a/to_b (0.05s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_route_and_multi_destination/a (0.06s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_in_route_and_multi_destination (0.13s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_multi_destination/a/to_b (0.28s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_multi_destination/a (0.29s) PASS tests/integration/pilot.TestTraffic/virtualservice/set_host_header_multi_destination (0.35s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect/a/to_b (0.23s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect/a (0.24s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect (0.33s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_port_and_scheme/a/to_b (0.24s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_port_and_scheme/a (0.25s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_port_and_scheme (0.33s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_request_port/to_default (0.34s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_request_port/to_default_with_host_port (0.01s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_request_port/non-default (0.01s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_request_port/non-default_with_host_port (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/redirect_request_port (0.40s) PASS tests/integration/pilot.TestTraffic/virtualservice/weird_header_matches/a/to_b/no_match (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/weird_header_matches/a/to_b/match (0.35s) PASS tests/integration/pilot.TestTraffic/virtualservice/weird_header_matches/a/to_b (0.41s) PASS tests/integration/pilot.TestTraffic/virtualservice/weird_header_matches/a (0.43s) PASS tests/integration/pilot.TestTraffic/virtualservice/weird_header_matches (0.49s) PASS tests/integration/pilot.TestTraffic/virtualservice/pseudo_header_matches/a/to_b/no_match (0.01s) PASS tests/integration/pilot.TestTraffic/virtualservice/pseudo_header_matches/a/to_b/match (0.19s) PASS tests/integration/pilot.TestTraffic/virtualservice/pseudo_header_matches/a/to_b (0.25s) PASS tests/integration/pilot.TestTraffic/virtualservice/pseudo_header_matches/a (0.25s) PASS tests/integration/pilot.TestTraffic/virtualservice/pseudo_header_matches (0.31s) PASS tests/integration/pilot.TestTraffic/virtualservice/rewrite_uri/a/to_b (0.29s) PASS tests/integration/pilot.TestTraffic/virtualservice/rewrite_uri/a (0.30s) PASS tests/integration/pilot.TestTraffic/virtualservice/rewrite_uri (0.36s) PASS tests/integration/pilot.TestTraffic/virtualservice/rewrite_authority/a/to_b (0.24s) PASS tests/integration/pilot.TestTraffic/virtualservice/rewrite_authority/a (0.25s) PASS tests/integration/pilot.TestTraffic/virtualservice/rewrite_authority (0.32s) PASS tests/integration/pilot.TestTraffic/virtualservice/cors/a/to_b/preflight (0.18s) PASS tests/integration/pilot.TestTraffic/virtualservice/cors/a/to_b/get (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/cors/a/to_b/get_no_origin_match (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/cors/a/to_b (0.28s) PASS tests/integration/pilot.TestTraffic/virtualservice/cors/a (0.29s) PASS tests/integration/pilot.TestTraffic/virtualservice/cors (0.40s) PASS tests/integration/pilot.TestTraffic/virtualservice/retry_conditions/a/to_b (0.09s) PASS tests/integration/pilot.TestTraffic/virtualservice/retry_conditions/a (0.10s) PASS tests/integration/pilot.TestTraffic/virtualservice/retry_conditions (0.18s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort/a/to_b (0.38s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort/a (0.38s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort (0.44s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort_gRPC/a/to_b (0.38s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort_gRPC/a (0.39s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort_gRPC/proxyless-grpc/to_b (0.12s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort_gRPC/proxyless-grpc (0.13s) PASS tests/integration/pilot.TestTraffic/virtualservice/fault_abort_gRPC (0.57s) PASS tests/integration/pilot.TestTraffic/virtualservice/catch_all_route_short_circuit_the_other_routes/a/to_b (0.20s) PASS tests/integration/pilot.TestTraffic/virtualservice/catch_all_route_short_circuit_the_other_routes/a (0.21s) PASS tests/integration/pilot.TestTraffic/virtualservice/catch_all_route_short_circuit_the_other_routes (0.27s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-50/a/to_b_c (0.40s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-50/a (0.41s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-50/proxyless-grpc/to_b_c (0.11s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-50/proxyless-grpc (0.12s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-50 (0.58s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers/a/to_b/end-user_is_jason (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers/a/to_b/end-user_is_not_jason (0.18s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers/a/to_b/do_not_have_end-user_header (0.01s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers/a/to_b (0.26s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers/a (0.27s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers (0.37s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match/a/to_b/have_end-user_header_and_value (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match/a/to_b/have_end-user_header_but_value_is_empty (0.17s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match/a/to_b/do_not_have_end-user_header (0.01s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match/a/to_b (0.26s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match/a (0.27s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match (0.33s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string/a/to_b/have_end-user_header_and_value (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string/a/to_b/have_end-user_header_but_value_is_empty (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string/a/to_b/do_not_have_end-user_header (0.01s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string/a/to_b (0.10s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string/a (0.11s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string (0.19s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-80/a/to_b_c (0.32s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-80/a (0.33s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-80/proxyless-grpc/to_b_c (0.11s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-80/proxyless-grpc (0.12s) PASS tests/integration/pilot.TestTraffic/virtualservice/shifting-80 (0.50s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers#01/a/to_b/end-user_is_jason (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers#01/a/to_b/end-user_is_not_jason (0.19s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers#01/a/to_b/do_not_have_end-user_header (0.01s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers#01/a/to_b (0.27s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers#01/a (0.28s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers#01 (0.39s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match#01/a/to_b/have_end-user_header_and_value (0.03s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match#01/a/to_b/have_end-user_header_but_value_is_empty (0.04s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match#01/a/to_b/do_not_have_end-user_header (0.10s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match#01/a/to_b (0.22s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match#01/a (0.23s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_convert_to_present_match#01 (0.33s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string#01/a/to_b/have_end-user_header_and_value (0.06s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string#01/a/to_b/have_end-user_header_but_value_is_empty (0.02s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string#01/a/to_b/do_not_have_end-user_header (0.07s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string#01/a/to_b (0.21s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string#01/a (0.22s) PASS tests/integration/pilot.TestTraffic/virtualservice/without_headers_regex_match_any_string#01 (0.31s) PASS tests/integration/pilot.TestTraffic/virtualservice (9.58s) PASS tests/integration/pilot.TestTraffic/sniffing/http/a.echo/to_b.echo (0.07s) PASS tests/integration/pilot.TestTraffic/sniffing/http/a.echo/to_external.external (0.05s) PASS tests/integration/pilot.TestTraffic/sniffing/http/a.echo/to_headless.echo (0.06s) PASS tests/integration/pilot.TestTraffic/sniffing/http/a.echo/to_naked.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/http/a.echo/to_statefulset.echo (0.07s) PASS tests/integration/pilot.TestTraffic/sniffing/http/a.echo (0.30s) PASS tests/integration/pilot.TestTraffic/sniffing/http/headless.echo/to_b.echo (0.07s) PASS tests/integration/pilot.TestTraffic/sniffing/http/headless.echo/to_external.external (0.06s) PASS tests/integration/pilot.TestTraffic/sniffing/http/headless.echo/to_headless.echo (0.03s) PASS tests/integration/pilot.TestTraffic/sniffing/http/headless.echo/to_naked.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/http/headless.echo/to_statefulset.echo (0.08s) PASS tests/integration/pilot.TestTraffic/sniffing/http/headless.echo (0.28s) PASS tests/integration/pilot.TestTraffic/sniffing/http/naked.echo (0.10s) PASS tests/integration/pilot.TestTraffic/sniffing/http/proxyless-grpc.echo/to_b.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/http/proxyless-grpc.echo/to_naked.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/http/proxyless-grpc.echo (0.14s) PASS tests/integration/pilot.TestTraffic/sniffing/http/statefulset.echo/to_b.echo (0.07s) PASS tests/integration/pilot.TestTraffic/sniffing/http/statefulset.echo/to_external.external (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/http/statefulset.echo/to_headless.echo (0.06s) PASS tests/integration/pilot.TestTraffic/sniffing/http/statefulset.echo/to_naked.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/http/statefulset.echo/to_statefulset.echo (0.03s) PASS tests/integration/pilot.TestTraffic/sniffing/http/statefulset.echo (0.24s) PASS tests/integration/pilot.TestTraffic/sniffing/http (1.13s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/a.echo/to_b.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/a.echo/to_external.external (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/a.echo/to_headless.echo (0.05s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/a.echo/to_naked.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/a.echo/to_statefulset.echo (0.05s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/a.echo (0.23s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/headless.echo/to_b.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/headless.echo/to_external.external (0.03s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/headless.echo/to_headless.echo (0.03s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/headless.echo/to_naked.echo (0.03s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/headless.echo/to_statefulset.echo (0.05s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/headless.echo (0.19s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/naked.echo (0.08s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_b.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_naked.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/proxyless-grpc.echo (0.14s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/statefulset.echo/to_b.echo (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/statefulset.echo/to_external.external (0.04s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/statefulset.echo/to_headless.echo (0.05s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/statefulset.echo/to_naked.echo (0.03s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/statefulset.echo/to_statefulset.echo (0.02s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http/statefulset.echo (0.20s) PASS tests/integration/pilot.TestTraffic/sniffing/auto-http (0.92s) PASS tests/integration/pilot.TestTraffic/selfcall/to_service/a.echo (0.11s) PASS tests/integration/pilot.TestTraffic/selfcall/to_service (0.20s) PASS tests/integration/pilot.TestTraffic/selfcall/to_localhost/a.echo (0.10s) PASS tests/integration/pilot.TestTraffic/selfcall/to_localhost (0.17s) PASS tests/integration/pilot.TestTraffic/selfcall/to_podIP/a.echo (0.10s) PASS tests/integration/pilot.TestTraffic/selfcall/to_podIP (0.18s) PASS tests/integration/pilot.TestTraffic/selfcall (0.55s) PASS tests/integration/pilot.TestTraffic/serverfirst/auto-tcp-server:DISABLE/DISABLE (0.38s) PASS tests/integration/pilot.TestTraffic/serverfirst/auto-tcp-server:DISABLE/PERMISSIVE (0.35s) PASS tests/integration/pilot.TestTraffic/serverfirst/auto-tcp-server:DISABLE/STRICT (0.36s) PASS tests/integration/pilot.TestTraffic/serverfirst/auto-tcp-server:ISTIO_MUTUAL/DISABLE (0.35s) PASS tests/integration/pilot.TestTraffic/serverfirst/auto-tcp-server:ISTIO_MUTUAL/PERMISSIVE (0.39s) PASS tests/integration/pilot.TestTraffic/serverfirst/auto-tcp-server:ISTIO_MUTUAL/STRICT (0.37s) PASS tests/integration/pilot.TestTraffic/serverfirst/tcp-server:DISABLE/DISABLE (0.06s) PASS tests/integration/pilot.TestTraffic/serverfirst/tcp-server:DISABLE/PERMISSIVE (0.69s) PASS tests/integration/pilot.TestTraffic/serverfirst/tcp-server:DISABLE/STRICT (0.37s) PASS tests/integration/pilot.TestTraffic/serverfirst/tcp-server:ISTIO_MUTUAL/DISABLE (0.36s) PASS tests/integration/pilot.TestTraffic/serverfirst/tcp-server:DISABLE/DISABLE#01 (0.24s) PASS tests/integration/pilot.TestTraffic/serverfirst/tcp-server:ISTIO_MUTUAL/PERMISSIVE (0.05s) PASS tests/integration/pilot.TestTraffic/serverfirst/tcp-server:ISTIO_MUTUAL/STRICT (0.06s) PASS tests/integration/pilot.TestTraffic/serverfirst (4.03s) PASS tests/integration/pilot.TestTraffic/gateway/404/to_b (0.28s) PASS tests/integration/pilot.TestTraffic/gateway/404 (0.43s) PASS tests/integration/pilot.TestTraffic/gateway/https_redirect/to_b (0.22s) PASS tests/integration/pilot.TestTraffic/gateway/https_redirect (0.41s) PASS tests/integration/pilot.TestTraffic/gateway/https_with_x-forwarded-proto/to_b (0.52s) PASS tests/integration/pilot.TestTraffic/gateway/https_with_x-forwarded-proto (0.64s) PASS tests/integration/pilot.TestTraffic/gateway/optional_mTLS/to_b.echo (0.28s) PASS tests/integration/pilot.TestTraffic/gateway/optional_mTLS/to_external.external (0.25s) PASS tests/integration/pilot.TestTraffic/gateway/optional_mTLS/to_headless.echo (0.28s) PASS tests/integration/pilot.TestTraffic/gateway/optional_mTLS/to_naked.echo (0.27s) PASS tests/integration/pilot.TestTraffic/gateway/optional_mTLS/to_statefulset.echo (0.27s) PASS tests/integration/pilot.TestTraffic/gateway/optional_mTLS (1.44s) PASS tests/integration/pilot.TestTraffic/gateway/http_redirect_when_vs_port_specify_https/to_b (0.24s) PASS tests/integration/pilot.TestTraffic/gateway/http_redirect_when_vs_port_specify_https (0.33s) PASS tests/integration/pilot.TestTraffic/gateway/http_return_400_with_with_x-forwarded-proto_https_when_vs_port_specify_https/to_b (0.40s) PASS tests/integration/pilot.TestTraffic/gateway/http_return_400_with_with_x-forwarded-proto_https_when_vs_port_specify_https (0.51s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1/to_b (0.39s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1 (0.52s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2/to_b (0.06s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2 (0.14s) PASS tests/integration/pilot.TestTraffic/gateway/wildcard_hostname/to_b/no_port (0.16s) PASS tests/integration/pilot.TestTraffic/gateway/wildcard_hostname/to_b/correct_port (0.01s) PASS tests/integration/pilot.TestTraffic/gateway/wildcard_hostname/to_b/random_port (0.01s) PASS tests/integration/pilot.TestTraffic/gateway/wildcard_hostname/to_b (0.24s) PASS tests/integration/pilot.TestTraffic/gateway/wildcard_hostname (0.34s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2_use_client_with_{auto-http_HTTP_81_18081_false_false_false_false_false}/to_b (0.42s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2_use_client_with_{auto-http_HTTP_81_18081_false_false_false_false_false} (0.50s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1_use_client_with_{auto-http_HTTP_81_18081_false_false_false_false_false}/to_b (0.15s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1_use_client_with_{auto-http_HTTP_81_18081_false_false_false_false_false} (0.25s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2_use_client_with_{http_HTTP_80_18080_false_false_false_false_false}/to_b (0.39s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2_use_client_with_{http_HTTP_80_18080_false_false_false_false_false} (0.47s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1_use_client_with_{http_HTTP_80_18080_false_false_false_false_false}/to_b (0.08s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1_use_client_with_{http_HTTP_80_18080_false_false_false_false_false} (0.17s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2_use_client_with_{http2_HTTP_85_18085_false_false_false_false_false}/to_b (0.39s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http2_use_client_with_{http2_HTTP_85_18085_false_false_false_false_false} (0.46s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1_use_client_with_{http2_HTTP_85_18085_false_false_false_false_false}/to_b (0.07s) PASS tests/integration/pilot.TestTraffic/gateway/client_protocol_-_http1_use_client_with_{http2_HTTP_85_18085_false_false_false_false_false} (0.15s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP/to_b.echo (0.07s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP/to_external.external (0.39s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP/to_headless.echo (0.30s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP/to_naked.echo (0.22s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP/to_statefulset.echo (0.22s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP (1.25s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP_scheme_match/to_b (0.23s) PASS tests/integration/pilot.TestTraffic/gateway/HTTP_scheme_match (0.33s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS/to_b.echo (0.29s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS/to_external.external (0.25s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS/to_headless.echo (0.27s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS/to_naked.echo (0.25s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS/to_statefulset.echo (0.25s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS (1.39s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_scheme_match/to_b (0.25s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_scheme_match (0.37s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_re-encrypt/to_b.echo (0.10s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_re-encrypt/to_external.external (0.43s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_re-encrypt/to_headless.echo (0.44s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_re-encrypt/to_naked.echo (0.45s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_re-encrypt/to_statefulset.echo (0.46s) PASS tests/integration/pilot.TestTraffic/gateway/HTTPS_re-encrypt (1.95s) PASS tests/integration/pilot.TestTraffic/gateway (12.05s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio (0.04s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-h2 (0.04s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|80||naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio (0.04s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound|9443||naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:STRICT,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.03s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.03s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-h2 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|80||naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio (0.03s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-h2 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:PERMISSIVE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||a.echo.svc.cluster.local,alpn:istio-h2 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.03s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.05s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.03s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn:istio-h2 (0.03s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.a.echo.svc.cluster.local,alpn: (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.03s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|80||naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.80_._.naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio (0.02s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.a.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound|9443||naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-peer-exchange (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-http/1.0 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn:istio-h2 (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough/mode:DISABLE,sni:outbound_.9443_._.naked.echo.svc.cluster.local,alpn: (0.01s) PASS tests/integration/pilot.TestTraffic/autopassthrough (2.07s) PASS tests/integration/pilot.TestTraffic/loop/15001 (0.01s) PASS tests/integration/pilot.TestTraffic/loop/15006 (0.01s) PASS tests/integration/pilot.TestTraffic/loop (0.02s) PASS tests/integration/pilot.TestTraffic/tls-origination/DNS/primary-0:_http/1.1 (1.08s) PASS tests/integration/pilot.TestTraffic/tls-origination/DNS/primary-0:_h2 (0.03s) PASS tests/integration/pilot.TestTraffic/tls-origination/DNS (1.13s) PASS tests/integration/pilot.TestTraffic/tls-origination/NONE/primary-0:_http/1.1 (0.54s) PASS tests/integration/pilot.TestTraffic/tls-origination/NONE/primary-0:_h2 (0.02s) PASS tests/integration/pilot.TestTraffic/tls-origination/NONE (0.61s) PASS tests/integration/pilot.TestTraffic/tls-origination/Redirect_NONE/primary-0:_http/1.1 (0.01s) PASS tests/integration/pilot.TestTraffic/tls-origination/Redirect_NONE/primary-0:_http/1.1#01 (0.84s) PASS tests/integration/pilot.TestTraffic/tls-origination/Redirect_NONE (0.92s) PASS tests/integration/pilot.TestTraffic/tls-origination (2.66s) PASS tests/integration/pilot.TestTraffic/instanceip/instance_IP_without_sidecar (0.02s) PASS tests/integration/pilot.TestTraffic/instanceip/instance_IP_with_wildcard_sidecar (0.04s) PASS tests/integration/pilot.TestTraffic/instanceip/instance_IP_with_localhost_sidecar (0.38s) PASS tests/integration/pilot.TestTraffic/instanceip/instance_IP_with_empty_sidecar (0.22s) PASS tests/integration/pilot.TestTraffic/instanceip/localhost_IP_without_sidecar (0.18s) PASS tests/integration/pilot.TestTraffic/instanceip/localhost_IP_with_wildcard_sidecar (0.20s) PASS tests/integration/pilot.TestTraffic/instanceip/localhost_IP_with_localhost_sidecar (0.34s) PASS tests/integration/pilot.TestTraffic/instanceip/localhost_IP_with_empty_sidecar (0.34s) PASS tests/integration/pilot.TestTraffic/instanceip/wildcard_IP_without_sidecar (0.03s) PASS tests/integration/pilot.TestTraffic/instanceip/wildcard_IP_with_wildcard_sidecar (0.04s) PASS tests/integration/pilot.TestTraffic/instanceip/wildcard_IP_with_localhost_sidecar (0.04s) PASS tests/integration/pilot.TestTraffic/instanceip/wildcard_IP_with_empty_sidecar (0.03s) PASS tests/integration/pilot.TestTraffic/instanceip (1.87s) PASS tests/integration/pilot.TestTraffic/services/case_1_both_match_in_cluster_primary-0 (0.34s) PASS tests/integration/pilot.TestTraffic/services/case_2_service_port_match_in_cluster_primary-0 (0.20s) PASS tests/integration/pilot.TestTraffic/services/case_3_target_port_match_in_cluster_primary-0 (0.17s) PASS tests/integration/pilot.TestTraffic/services/case_4_no_match_in_cluster_primary-0 (0.18s) PASS tests/integration/pilot.TestTraffic/services (0.90s) PASS tests/integration/pilot.TestTraffic/externalname/without_port/http (0.26s) PASS tests/integration/pilot.TestTraffic/externalname/without_port/auto-http (0.03s) PASS tests/integration/pilot.TestTraffic/externalname/without_port/tcp (0.03s) PASS tests/integration/pilot.TestTraffic/externalname/without_port/https (0.07s) PASS tests/integration/pilot.TestTraffic/externalname/without_port (0.41s) PASS tests/integration/pilot.TestTraffic/externalname/with_port/http (0.19s) PASS tests/integration/pilot.TestTraffic/externalname/with_port/auto-http (0.02s) PASS tests/integration/pilot.TestTraffic/externalname/with_port/tcp (0.02s) PASS tests/integration/pilot.TestTraffic/externalname/with_port/https (0.05s) PASS tests/integration/pilot.TestTraffic/externalname/with_port (0.32s) PASS tests/integration/pilot.TestTraffic/externalname/routed/http (0.03s) PASS tests/integration/pilot.TestTraffic/externalname/routed/auto-http (0.02s) PASS tests/integration/pilot.TestTraffic/externalname/routed/tcp (0.02s) PASS tests/integration/pilot.TestTraffic/externalname/routed/https (0.04s) PASS tests/integration/pilot.TestTraffic/externalname/routed (0.16s) PASS tests/integration/pilot.TestTraffic/externalname/gateway (0.39s) PASS tests/integration/pilot.TestTraffic/externalname (1.29s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc.cluster.local/auto-http (0.03s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc.cluster.local:18081/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc.cluster.local:12345/auto-http (0.02s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc:18081/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc:12345/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/headless/auto-http (0.05s) PASS tests/integration/pilot.TestTraffic/host/headless:18081/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/headless:12345/auto-http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc.cluster.local:18081/auto-http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc.cluster.local:12345/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc:12345/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless:18081/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless:12345/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/ip/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/ip:18081/auto-http (0.01s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc.cluster.local/http (0.03s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc.cluster.local:18080/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc.cluster.local:12345/http (0.01s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc:18080/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/headless.echo.svc:12345/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/headless/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/headless:18080/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/headless:12345/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc.cluster.local:18080/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc.cluster.local:12345/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc:18080/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless.echo.svc:12345/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless:18080/http (0.01s) PASS tests/integration/pilot.TestTraffic/host/some-instances.headless:12345/http (0.02s) PASS tests/integration/pilot.TestTraffic/host/ip/http (0.03s) PASS tests/integration/pilot.TestTraffic/host/ip:18080/http (0.02s) PASS tests/integration/pilot.TestTraffic/host (0.65s) PASS tests/integration/pilot.TestTraffic/envoyfilter (1.08s) PASS tests/integration/pilot.TestTraffic/consistent-hash/no_consistent (5.13s) PASS tests/integration/pilot.TestTraffic/consistent-hash/source_ip_a (0.51s) PASS tests/integration/pilot.TestTraffic/consistent-hash/query_parama (0.43s) PASS tests/integration/pilot.TestTraffic/consistent-hash/http_headera (0.23s) PASS tests/integration/pilot.TestTraffic/consistent-hash/tcp_source_ip_a (0.48s) PASS tests/integration/pilot.TestTraffic/consistent-hash/no_consistent#01 (0.38s) PASS tests/integration/pilot.TestTraffic/consistent-hash/source_ip_b (0.44s) PASS tests/integration/pilot.TestTraffic/consistent-hash/query_paramb (0.18s) PASS tests/integration/pilot.TestTraffic/consistent-hash/http_headerb (0.19s) PASS tests/integration/pilot.TestTraffic/consistent-hash/tcp_source_ip_b (0.22s) PASS tests/integration/pilot.TestTraffic/consistent-hash (8.22s) PASS tests/integration/pilot.TestTraffic/use-client-protocol/use_client_protocol_with_h2 (0.27s) PASS tests/integration/pilot.TestTraffic/use-client-protocol/use_client_protocol_with_h1 (0.07s) PASS tests/integration/pilot.TestTraffic/use-client-protocol (0.35s) PASS tests/integration/pilot.TestTraffic/destinationrule/only_idletimeout_specified_in_DR (0.03s) PASS tests/integration/pilot.TestTraffic/destinationrule (0.03s) PASS tests/integration/pilot.TestTraffic/dns/a/tcp_ipv4 (1.07s) PASS tests/integration/pilot.TestTraffic/dns/a/udp_ipv4 (0.03s) PASS tests/integration/pilot.TestTraffic/dns/a/tcp_ipv6 (0.20s) PASS tests/integration/pilot.TestTraffic/dns/a/udp_ipv6 (0.04s) PASS tests/integration/pilot.TestTraffic/dns/svc/a/primary-0/tcp (0.01s) PASS tests/integration/pilot.TestTraffic/dns/svc/a/primary-0/udp (0.01s) PASS tests/integration/pilot.TestTraffic/dns (1.34s) PASS tests/integration/pilot.TestTraffic/externalservice/echo/a_to_external_service_172.30.106.103 (0.05s) PASS tests/integration/pilot.TestTraffic/externalservice/echo/a_to_external_service_1.1.1.1 (0.03s) PASS tests/integration/pilot.TestTraffic/externalservice/echo/b_to_external_service_172.30.106.103 (0.05s) PASS tests/integration/pilot.TestTraffic/externalservice/echo/b_to_external_service_1.1.1.1 (0.03s) PASS tests/integration/pilot.TestTraffic/externalservice (0.16s) PASS tests/integration/pilot.TestTraffic/upstreamproxy/proxy (0.21s) PASS tests/integration/pilot.TestTraffic/upstreamproxy (0.21s) PASS tests/integration/pilot.TestTraffic/service-entry-vips-resolution-none/send_a_request_to_one_of_the_service_entry_VIPs (0.33s) PASS tests/integration/pilot.TestTraffic/service-entry-vips-resolution-none (0.42s) PASS tests/integration/pilot.TestTraffic (64.31s) PASS tests/integration/pilot.TestTcpProbe/norewrite-success (8.22s) PASS tests/integration/pilot.TestTcpProbe/rewrite-success (8.13s) PASS tests/integration/pilot.TestTcpProbe (16.38s) === RUN TestTunnelingOutboundTraffic 2025-08-04T19:47:01.676850Z info tf === BEGIN: Test: 'pilot[TestTunnelingOutboundTraffic]' === 2025-08-04T19:47:01.910766Z info tf Checking pods ready... 2025-08-04T19:47:01.910819Z info tf Checking pods ready... 2025-08-04T19:47:01.915445Z info tf Failed retrieving pods: no matching pod found for selectors: [app=external-forward-proxy] 2025-08-04T19:47:02.116537Z info tf Checking pods ready... 2025-08-04T19:47:02.116643Z info tf Checking pods ready... 2025-08-04T19:47:02.121361Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:02.522486Z info tf Checking pods ready... 2025-08-04T19:47:02.522566Z info tf Checking pods ready... 2025-08-04T19:47:02.527197Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:03.327380Z info tf Checking pods ready... 2025-08-04T19:47:03.327502Z info tf Checking pods ready... 2025-08-04T19:47:03.350935Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:04.952109Z info tf Checking pods ready... 2025-08-04T19:47:04.952222Z info tf Checking pods ready... 2025-08-04T19:47:04.957485Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:08.158455Z info tf Checking pods ready... 2025-08-04T19:47:08.158612Z info tf Checking pods ready... 2025-08-04T19:47:08.318943Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:11.519884Z info tf Checking pods ready... 2025-08-04T19:47:11.519989Z info tf Checking pods ready... 2025-08-04T19:47:11.524403Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:12.962075Z error port forward failed: lost connection to pod 2025-08-04T19:47:13.037543Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:47:13.124828Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:47:13.176399Z error port forward failed: lost connection to pod 2025-08-04T19:47:13.389691Z error port forward failed: lost connection to pod 2025-08-04T19:47:13.520240Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:47:13.544204Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:47:13.590242Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:47:13.625388Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:47:14.725570Z info tf Checking pods ready... 2025-08-04T19:47:14.725656Z info tf Checking pods ready... 2025-08-04T19:47:14.731340Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:15.490198Z error port forward failed: lost connection to pod 2025-08-04T19:47:15.876798Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:47:15.954283Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:47:17.273205Z error port forward failed: lost connection to pod 2025-08-04T19:47:17.701974Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:47:17.761893Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:47:17.932430Z info tf Checking pods ready... 2025-08-04T19:47:17.932534Z info tf Checking pods ready... 2025-08-04T19:47:17.948036Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:18.243832Z error port forward failed: lost connection to pod 2025-08-04T19:47:18.621805Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:47:18.691438Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:47:21.148781Z info tf Checking pods ready... 2025-08-04T19:47:21.148856Z info tf Checking pods ready... 2025-08-04T19:47:21.153799Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:24.354649Z info tf Checking pods ready... 2025-08-04T19:47:24.354738Z info tf Checking pods ready... 2025-08-04T19:47:24.360176Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:27.560334Z info tf Checking pods ready... 2025-08-04T19:47:27.560393Z info tf Checking pods ready... 2025-08-04T19:47:27.564167Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:30.764284Z info tf Checking pods ready... 2025-08-04T19:47:30.764362Z info tf Checking pods ready... 2025-08-04T19:47:30.770044Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:33.971255Z info tf Checking pods ready... 2025-08-04T19:47:33.971344Z info tf Checking pods ready... 2025-08-04T19:47:33.975988Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:37.177108Z info tf Checking pods ready... 2025-08-04T19:47:37.177191Z info tf Checking pods ready... 2025-08-04T19:47:37.187060Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:40.388056Z info tf Checking pods ready... 2025-08-04T19:47:40.388157Z info tf Checking pods ready... 2025-08-04T19:47:40.392414Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:43.593612Z info tf Checking pods ready... 2025-08-04T19:47:43.593714Z info tf Checking pods ready... 2025-08-04T19:47:43.598621Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:46.799791Z info tf Checking pods ready... 2025-08-04T19:47:46.799845Z info tf Checking pods ready... 2025-08-04T19:47:46.814629Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:50.015787Z info tf Checking pods ready... 2025-08-04T19:47:50.015898Z info tf Checking pods ready... 2025-08-04T19:47:50.020544Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:50.665985Z error port forward failed: lost connection to pod 2025-08-04T19:47:51.095242Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:47:51.161712Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:47:51.287497Z error port forward failed: lost connection to pod 2025-08-04T19:47:51.364710Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:47:51.427803Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:47:53.221271Z info tf Checking pods ready... 2025-08-04T19:47:53.221353Z info tf Checking pods ready... 2025-08-04T19:47:53.225336Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:56.426202Z info tf Checking pods ready... 2025-08-04T19:47:56.426283Z info tf Checking pods ready... 2025-08-04T19:47:56.435006Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:59.635980Z info tf Checking pods ready... 2025-08-04T19:47:59.636054Z info tf Checking pods ready... 2025-08-04T19:47:59.641031Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:02.841792Z info tf Checking pods ready... 2025-08-04T19:48:02.841893Z info tf Checking pods ready... 2025-08-04T19:48:02.846262Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:06.046384Z info tf Checking pods ready... 2025-08-04T19:48:06.046463Z info tf Checking pods ready... 2025-08-04T19:48:06.053844Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:06.461657Z error port forward failed: lost connection to pod 2025-08-04T19:48:06.886294Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:48:06.962526Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:48:09.254635Z info tf Checking pods ready... 2025-08-04T19:48:09.254718Z info tf Checking pods ready... 2025-08-04T19:48:09.260644Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:12.461642Z info tf Checking pods ready... 2025-08-04T19:48:12.461730Z info tf Checking pods ready... 2025-08-04T19:48:12.465982Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:15.666776Z info tf Checking pods ready... 2025-08-04T19:48:15.666882Z info tf Checking pods ready... 2025-08-04T19:48:15.671710Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:18.872504Z info tf Checking pods ready... 2025-08-04T19:48:18.872557Z info tf Checking pods ready... 2025-08-04T19:48:18.880516Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:19.129137Z error port forward failed: lost connection to pod 2025-08-04T19:48:19.537736Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:48:19.593984Z error port forward failed: lost connection to pod 2025-08-04T19:48:19.621411Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:48:19.630398Z error port forward failed: lost connection to pod 2025-08-04T19:48:20.019935Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:48:20.043528Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:48:20.102834Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:48:20.133802Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:48:21.963750Z error port forward failed: lost connection to pod 2025-08-04T19:48:22.080929Z info tf Checking pods ready... 2025-08-04T19:48:22.081003Z info tf Checking pods ready... 2025-08-04T19:48:22.086434Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:22.376941Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:48:22.445310Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:48:23.766679Z error port forward failed: lost connection to pod 2025-08-04T19:48:24.202299Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:48:24.265144Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:48:24.696686Z error port forward failed: lost connection to pod 2025-08-04T19:48:25.120706Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:48:25.191620Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:48:25.287322Z info tf Checking pods ready... 2025-08-04T19:48:25.287421Z info tf Checking pods ready... 2025-08-04T19:48:25.292293Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:28.492783Z info tf Checking pods ready... 2025-08-04T19:48:28.492886Z info tf Checking pods ready... 2025-08-04T19:48:28.499022Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:31.699397Z info tf Checking pods ready... 2025-08-04T19:48:31.699456Z info tf Checking pods ready... 2025-08-04T19:48:31.703376Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:34.904328Z info tf Checking pods ready... 2025-08-04T19:48:34.904387Z info tf Checking pods ready... 2025-08-04T19:48:34.909725Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:38.110254Z info tf Checking pods ready... 2025-08-04T19:48:38.110346Z info tf Checking pods ready... 2025-08-04T19:48:38.117067Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:41.317570Z info tf Checking pods ready... 2025-08-04T19:48:41.317658Z info tf Checking pods ready... 2025-08-04T19:48:41.324284Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:44.525322Z info tf Checking pods ready... 2025-08-04T19:48:44.525387Z info tf Checking pods ready... 2025-08-04T19:48:44.532015Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:47.733033Z info tf Checking pods ready... 2025-08-04T19:48:47.733117Z info tf Checking pods ready... 2025-08-04T19:48:47.737862Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:50.938271Z info tf Checking pods ready... 2025-08-04T19:48:50.938315Z info tf Checking pods ready... 2025-08-04T19:48:50.945371Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:54.146073Z info tf Checking pods ready... 2025-08-04T19:48:54.146115Z info tf Checking pods ready... 2025-08-04T19:48:54.150954Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:57.166424Z error port forward failed: lost connection to pod 2025-08-04T19:48:57.351467Z info tf Checking pods ready... 2025-08-04T19:48:57.351563Z info tf Checking pods ready... 2025-08-04T19:48:57.363614Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:57.432046Z error port forward failed: lost connection to pod 2025-08-04T19:48:57.595430Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:48:57.658975Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:48:57.864439Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:48:57.929016Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:49:00.564240Z info tf Checking pods ready... 2025-08-04T19:49:00.564334Z info tf Checking pods ready... 2025-08-04T19:49:00.568677Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:03.769286Z info tf Checking pods ready... 2025-08-04T19:49:03.769377Z info tf Checking pods ready... 2025-08-04T19:49:03.775402Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:06.976289Z info tf Checking pods ready... 2025-08-04T19:49:06.976395Z info tf Checking pods ready... 2025-08-04T19:49:06.981475Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:10.182450Z info tf Checking pods ready... 2025-08-04T19:49:10.182492Z info tf Checking pods ready... 2025-08-04T19:49:10.187122Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:12.967640Z error port forward failed: lost connection to pod 2025-08-04T19:49:13.386351Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:49:13.387485Z info tf Checking pods ready... 2025-08-04T19:49:13.387523Z info tf Checking pods ready... 2025-08-04T19:49:13.395264Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:13.459861Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:49:16.596285Z info tf Checking pods ready... 2025-08-04T19:49:16.596345Z info tf Checking pods ready... 2025-08-04T19:49:16.601841Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:19.802800Z info tf Checking pods ready... 2025-08-04T19:49:19.802853Z info tf Checking pods ready... 2025-08-04T19:49:19.808227Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:23.008670Z info tf Checking pods ready... 2025-08-04T19:49:23.008708Z info tf Checking pods ready... 2025-08-04T19:49:23.012676Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:25.626292Z error port forward failed: lost connection to pod 2025-08-04T19:49:26.036791Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:49:26.106359Z error port forward failed: lost connection to pod 2025-08-04T19:49:26.110409Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:49:26.137005Z error port forward failed: lost connection to pod 2025-08-04T19:49:26.213107Z info tf Checking pods ready... 2025-08-04T19:49:26.213218Z info tf Checking pods ready... 2025-08-04T19:49:26.218065Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:26.520135Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:49:26.543818Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:49:26.583873Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:49:26.614117Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:49:28.450025Z error port forward failed: lost connection to pod 2025-08-04T19:49:28.877222Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:49:28.941765Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:49:29.418599Z info tf Checking pods ready... 2025-08-04T19:49:29.418674Z info tf Checking pods ready... 2025-08-04T19:49:29.425176Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:30.271756Z error port forward failed: lost connection to pod 2025-08-04T19:49:30.701720Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:49:30.760393Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:49:31.196668Z error port forward failed: lost connection to pod 2025-08-04T19:49:31.621085Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:49:31.759110Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:49:32.626078Z info tf Checking pods ready... 2025-08-04T19:49:32.626128Z info tf Checking pods ready... 2025-08-04T19:49:32.630206Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:35.830384Z info tf Checking pods ready... 2025-08-04T19:49:35.830449Z info tf Checking pods ready... 2025-08-04T19:49:35.836736Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:39.037655Z info tf Checking pods ready... 2025-08-04T19:49:39.037701Z info tf Checking pods ready... 2025-08-04T19:49:39.041633Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:42.242750Z info tf Checking pods ready... 2025-08-04T19:49:42.242801Z info tf Checking pods ready... 2025-08-04T19:49:42.246296Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:45.446772Z info tf Checking pods ready... 2025-08-04T19:49:45.446819Z info tf Checking pods ready... 2025-08-04T19:49:45.451084Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:48.651966Z info tf Checking pods ready... 2025-08-04T19:49:48.652005Z info tf Checking pods ready... 2025-08-04T19:49:48.655556Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:51.856674Z info tf Checking pods ready... 2025-08-04T19:49:51.856727Z info tf Checking pods ready... 2025-08-04T19:49:51.861364Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:55.062368Z info tf Checking pods ready... 2025-08-04T19:49:55.062425Z info tf Checking pods ready... 2025-08-04T19:49:55.066758Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:58.267125Z info tf Checking pods ready... 2025-08-04T19:49:58.267208Z info tf Checking pods ready... 2025-08-04T19:49:58.272426Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:01.472962Z info tf Checking pods ready... 2025-08-04T19:50:01.473020Z info tf Checking pods ready... 2025-08-04T19:50:01.477827Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:03.664227Z error port forward failed: lost connection to pod 2025-08-04T19:50:03.934229Z error port forward failed: lost connection to pod 2025-08-04T19:50:04.095123Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:50:04.150078Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:50:04.364295Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:50:04.435864Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:50:04.679004Z info tf Checking pods ready... 2025-08-04T19:50:04.679095Z info tf Checking pods ready... 2025-08-04T19:50:04.684002Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:07.885062Z info tf Checking pods ready... 2025-08-04T19:50:07.885136Z info tf Checking pods ready... 2025-08-04T19:50:07.889938Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:11.090495Z info tf Checking pods ready... 2025-08-04T19:50:11.090574Z info tf Checking pods ready... 2025-08-04T19:50:11.095318Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:14.295534Z info tf Checking pods ready... 2025-08-04T19:50:14.295574Z info tf Checking pods ready... 2025-08-04T19:50:14.299706Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:17.499860Z info tf Checking pods ready... 2025-08-04T19:50:17.499936Z info tf Checking pods ready... 2025-08-04T19:50:17.504561Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:19.464797Z error port forward failed: lost connection to pod 2025-08-04T19:50:19.885329Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:50:19.951560Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:50:20.704655Z info tf Checking pods ready... 2025-08-04T19:50:20.704704Z info tf Checking pods ready... 2025-08-04T19:50:20.710459Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:23.910887Z info tf Checking pods ready... 2025-08-04T19:50:23.910979Z info tf Checking pods ready... 2025-08-04T19:50:23.916011Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:27.116889Z info tf Checking pods ready... 2025-08-04T19:50:27.116970Z info tf Checking pods ready... 2025-08-04T19:50:27.121412Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:30.321715Z info tf Checking pods ready... 2025-08-04T19:50:30.321784Z info tf Checking pods ready... 2025-08-04T19:50:30.325969Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:32.115974Z error port forward failed: lost connection to pod 2025-08-04T19:50:32.537543Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:50:32.587736Z error port forward failed: lost connection to pod 2025-08-04T19:50:32.600357Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:50:32.620544Z error port forward failed: lost connection to pod 2025-08-04T19:50:33.020607Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:50:33.043426Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:50:33.083810Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:50:33.111620Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:50:33.526440Z info tf Checking pods ready... 2025-08-04T19:50:33.526518Z info tf Checking pods ready... 2025-08-04T19:50:33.534680Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:34.946821Z error port forward failed: lost connection to pod 2025-08-04T19:50:35.377543Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:50:35.461034Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:50:36.734881Z info tf Checking pods ready... 2025-08-04T19:50:36.734968Z info tf Checking pods ready... 2025-08-04T19:50:36.740391Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:36.764490Z error port forward failed: lost connection to pod 2025-08-04T19:50:37.202223Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:50:37.269948Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:50:37.764199Z error port forward failed: lost connection to pod 2025-08-04T19:50:38.121143Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:50:38.182052Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:50:39.941181Z info tf Checking pods ready... 2025-08-04T19:50:39.941236Z info tf Checking pods ready... 2025-08-04T19:50:39.946802Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:43.147479Z info tf Checking pods ready... 2025-08-04T19:50:43.147534Z info tf Checking pods ready... 2025-08-04T19:50:43.151589Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:46.352046Z info tf Checking pods ready... 2025-08-04T19:50:46.352115Z info tf Checking pods ready... 2025-08-04T19:50:46.359163Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:49.560059Z info tf Checking pods ready... 2025-08-04T19:50:49.560134Z info tf Checking pods ready... 2025-08-04T19:50:49.565175Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:52.765520Z info tf Checking pods ready... 2025-08-04T19:50:52.765573Z info tf Checking pods ready... 2025-08-04T19:50:52.778210Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:55.978448Z info tf Checking pods ready... 2025-08-04T19:50:55.978583Z info tf Checking pods ready... 2025-08-04T19:50:55.989286Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:59.190076Z info tf Checking pods ready... 2025-08-04T19:50:59.190162Z info tf Checking pods ready... 2025-08-04T19:50:59.194159Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:02.394528Z info tf Checking pods ready... 2025-08-04T19:51:02.394605Z info tf Checking pods ready... 2025-08-04T19:51:02.399668Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:05.600744Z info tf Checking pods ready... 2025-08-04T19:51:05.600851Z info tf Checking pods ready... 2025-08-04T19:51:05.610519Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:08.811026Z info tf Checking pods ready... 2025-08-04T19:51:08.811111Z info tf Checking pods ready... 2025-08-04T19:51:08.817339Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:10.155407Z error port forward failed: lost connection to pod 2025-08-04T19:51:10.439951Z error port forward failed: lost connection to pod 2025-08-04T19:51:10.594463Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:51:10.663856Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:51:10.864016Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:51:10.932285Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:51:12.018101Z info tf Checking pods ready... 2025-08-04T19:51:12.018157Z info tf Checking pods ready... 2025-08-04T19:51:12.021870Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:15.222960Z info tf Checking pods ready... 2025-08-04T19:51:15.223049Z info tf Checking pods ready... 2025-08-04T19:51:15.230844Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:18.431750Z info tf Checking pods ready... 2025-08-04T19:51:18.431810Z info tf Checking pods ready... 2025-08-04T19:51:18.436010Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:21.636576Z info tf Checking pods ready... 2025-08-04T19:51:21.636627Z info tf Checking pods ready... 2025-08-04T19:51:21.640326Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:24.841500Z info tf Checking pods ready... 2025-08-04T19:51:24.841591Z info tf Checking pods ready... 2025-08-04T19:51:24.845917Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:25.956524Z error port forward failed: lost connection to pod 2025-08-04T19:51:26.386253Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:51:26.444505Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:51:28.046840Z info tf Checking pods ready... 2025-08-04T19:51:28.046920Z info tf Checking pods ready... 2025-08-04T19:51:28.051710Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:31.252900Z info tf Checking pods ready... 2025-08-04T19:51:31.252960Z info tf Checking pods ready... 2025-08-04T19:51:31.257418Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:34.458417Z info tf Checking pods ready... 2025-08-04T19:51:34.458505Z info tf Checking pods ready... 2025-08-04T19:51:34.463672Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:37.664133Z info tf Checking pods ready... 2025-08-04T19:51:37.664255Z info tf Checking pods ready... 2025-08-04T19:51:37.669609Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:38.605674Z error port forward failed: lost connection to pod 2025-08-04T19:51:39.037189Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:51:39.089389Z error port forward failed: lost connection to pod 2025-08-04T19:51:39.105583Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:51:39.116113Z error port forward failed: lost connection to pod 2025-08-04T19:51:39.520299Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:51:39.543956Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:51:39.588656Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:51:39.612087Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:51:40.870671Z info tf Checking pods ready... 2025-08-04T19:51:40.870790Z info tf Checking pods ready... 2025-08-04T19:51:40.875755Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:41.466851Z error port forward failed: lost connection to pod 2025-08-04T19:51:41.876926Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:51:41.934145Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:51:43.274816Z error port forward failed: lost connection to pod 2025-08-04T19:51:43.702546Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:51:43.770824Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:51:44.076533Z info tf Checking pods ready... 2025-08-04T19:51:44.076610Z info tf Checking pods ready... 2025-08-04T19:51:44.081977Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:44.188678Z error port forward failed: lost connection to pod 2025-08-04T19:51:44.621392Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:51:44.693637Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:51:47.282998Z info tf Checking pods ready... 2025-08-04T19:51:47.283075Z info tf Checking pods ready... 2025-08-04T19:51:47.287145Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:50.488215Z info tf Checking pods ready... 2025-08-04T19:51:50.488252Z info tf Checking pods ready... 2025-08-04T19:51:50.492421Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:53.692531Z info tf Checking pods ready... 2025-08-04T19:51:53.692600Z info tf Checking pods ready... 2025-08-04T19:51:53.697559Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:56.898318Z info tf Checking pods ready... 2025-08-04T19:51:56.898397Z info tf Checking pods ready... 2025-08-04T19:51:56.903961Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:00.104735Z info tf Checking pods ready... 2025-08-04T19:52:00.104834Z info tf Checking pods ready... 2025-08-04T19:52:00.111888Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:03.313027Z info tf Checking pods ready... 2025-08-04T19:52:03.313146Z info tf Checking pods ready... 2025-08-04T19:52:03.341958Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:06.542204Z info tf Checking pods ready... 2025-08-04T19:52:06.542289Z info tf Checking pods ready... 2025-08-04T19:52:06.546907Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:09.747963Z info tf Checking pods ready... 2025-08-04T19:52:09.748048Z info tf Checking pods ready... 2025-08-04T19:52:09.754957Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:12.955122Z info tf Checking pods ready... 2025-08-04T19:52:12.955249Z info tf Checking pods ready... 2025-08-04T19:52:12.962855Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:16.163008Z info tf Checking pods ready... 2025-08-04T19:52:16.163098Z info tf Checking pods ready... 2025-08-04T19:52:16.168008Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:16.673051Z error port forward failed: lost connection to pod 2025-08-04T19:52:16.938498Z error port forward failed: lost connection to pod 2025-08-04T19:52:17.095186Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:52:17.168377Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:52:17.364098Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:52:17.428115Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:52:19.369098Z info tf Checking pods ready... 2025-08-04T19:52:19.369173Z info tf Checking pods ready... 2025-08-04T19:52:19.377185Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:22.577974Z info tf Checking pods ready... 2025-08-04T19:52:22.578076Z info tf Checking pods ready... 2025-08-04T19:52:22.582816Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:25.783410Z info tf Checking pods ready... 2025-08-04T19:52:25.783516Z info tf Checking pods ready... 2025-08-04T19:52:25.788719Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:28.989513Z info tf Checking pods ready... 2025-08-04T19:52:28.989624Z info tf Checking pods ready... 2025-08-04T19:52:28.993519Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:32.193940Z info tf Checking pods ready... 2025-08-04T19:52:32.193989Z info tf Checking pods ready... 2025-08-04T19:52:32.198236Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:32.448322Z error port forward failed: lost connection to pod 2025-08-04T19:52:32.885749Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:52:32.949899Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:52:35.399301Z info tf Checking pods ready... 2025-08-04T19:52:35.399352Z info tf Checking pods ready... 2025-08-04T19:52:35.403747Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:38.604264Z info tf Checking pods ready... 2025-08-04T19:52:38.604338Z info tf Checking pods ready... 2025-08-04T19:52:38.609473Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:41.810628Z info tf Checking pods ready... 2025-08-04T19:52:41.810706Z info tf Checking pods ready... 2025-08-04T19:52:41.814752Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:45.015916Z info tf Checking pods ready... 2025-08-04T19:52:45.015979Z info tf Checking pods ready... 2025-08-04T19:52:45.020536Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:45.111401Z error port forward failed: lost connection to pod 2025-08-04T19:52:45.537508Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:52:45.594323Z error port forward failed: lost connection to pod 2025-08-04T19:52:45.602491Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:52:45.617143Z error port forward failed: lost connection to pod 2025-08-04T19:52:46.020645Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:52:46.044061Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:52:46.123676Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:52:46.146032Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:52:47.940798Z error port forward failed: lost connection to pod 2025-08-04T19:52:48.221475Z info tf Checking pods ready... 2025-08-04T19:52:48.221567Z info tf Checking pods ready... 2025-08-04T19:52:48.225856Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:48.377405Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:52:48.480123Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:52:49.775163Z error port forward failed: lost connection to pod 2025-08-04T19:52:50.201726Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:52:50.267938Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:52:50.699226Z error port forward failed: lost connection to pod 2025-08-04T19:52:51.121537Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:52:51.198896Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:52:51.426273Z info tf Checking pods ready... 2025-08-04T19:52:51.426340Z info tf Checking pods ready... 2025-08-04T19:52:51.432006Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:54.632993Z info tf Checking pods ready... 2025-08-04T19:52:54.633053Z info tf Checking pods ready... 2025-08-04T19:52:54.637687Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:57.838373Z info tf Checking pods ready... 2025-08-04T19:52:57.838409Z info tf Checking pods ready... 2025-08-04T19:52:57.845424Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:01.045546Z info tf Checking pods ready... 2025-08-04T19:53:01.045619Z info tf Checking pods ready... 2025-08-04T19:53:01.051186Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:04.251401Z info tf Checking pods ready... 2025-08-04T19:53:04.251478Z info tf Checking pods ready... 2025-08-04T19:53:04.256394Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:07.456718Z info tf Checking pods ready... 2025-08-04T19:53:07.456777Z info tf Checking pods ready... 2025-08-04T19:53:07.462808Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:10.663509Z info tf Checking pods ready... 2025-08-04T19:53:10.663544Z info tf Checking pods ready... 2025-08-04T19:53:10.667461Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:13.867533Z info tf Checking pods ready... 2025-08-04T19:53:13.867604Z info tf Checking pods ready... 2025-08-04T19:53:13.874746Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:17.075307Z info tf Checking pods ready... 2025-08-04T19:53:17.075348Z info tf Checking pods ready... 2025-08-04T19:53:17.326046Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:20.526942Z info tf Checking pods ready... 2025-08-04T19:53:20.527074Z info tf Checking pods ready... 2025-08-04T19:53:21.008970Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:23.173498Z error port forward failed: lost connection to pod 2025-08-04T19:53:23.432845Z error port forward failed: lost connection to pod 2025-08-04T19:53:23.595402Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:53:23.728120Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:53:23.863893Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:53:23.932740Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:53:24.209356Z info tf Checking pods ready... 2025-08-04T19:53:24.209396Z info tf Checking pods ready... 2025-08-04T19:53:24.215104Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:27.415255Z info tf Checking pods ready... 2025-08-04T19:53:27.415295Z info tf Checking pods ready... 2025-08-04T19:53:27.419730Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:30.620437Z info tf Checking pods ready... 2025-08-04T19:53:30.620481Z info tf Checking pods ready... 2025-08-04T19:53:30.624558Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:33.825474Z info tf Checking pods ready... 2025-08-04T19:53:33.825548Z info tf Checking pods ready... 2025-08-04T19:53:33.830750Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:37.031172Z info tf Checking pods ready... 2025-08-04T19:53:37.031227Z info tf Checking pods ready... 2025-08-04T19:53:37.037240Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:38.955088Z error port forward failed: lost connection to pod 2025-08-04T19:53:39.385457Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:53:39.459948Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:53:40.238389Z info tf Checking pods ready... 2025-08-04T19:53:40.238455Z info tf Checking pods ready... 2025-08-04T19:53:40.242686Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:43.442840Z info tf Checking pods ready... 2025-08-04T19:53:43.442893Z info tf Checking pods ready... 2025-08-04T19:53:43.447533Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:46.648381Z info tf Checking pods ready... 2025-08-04T19:53:46.648446Z info tf Checking pods ready... 2025-08-04T19:53:46.654550Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:49.855748Z info tf Checking pods ready... 2025-08-04T19:53:49.855871Z info tf Checking pods ready... 2025-08-04T19:53:49.861146Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:51.608523Z error port forward failed: lost connection to pod 2025-08-04T19:53:52.037554Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:53:52.106754Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:53:52.128608Z error port forward failed: lost connection to pod 2025-08-04T19:53:52.161486Z error port forward failed: lost connection to pod 2025-08-04T19:53:52.520740Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:53:52.543200Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:53:52.601164Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:53:52.626608Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:53:53.061294Z info tf Checking pods ready... 2025-08-04T19:53:53.061410Z info tf Checking pods ready... 2025-08-04T19:53:53.065844Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:54.486191Z error port forward failed: lost connection to pod 2025-08-04T19:53:54.877487Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:53:54.963821Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:53:56.267083Z info tf Checking pods ready... 2025-08-04T19:53:56.267156Z info tf Checking pods ready... 2025-08-04T19:53:56.272319Z error port forward failed: lost connection to pod 2025-08-04T19:53:56.273749Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:56.701878Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:53:56.767773Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:53:57.205603Z error port forward failed: lost connection to pod 2025-08-04T19:53:57.621173Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:53:57.698455Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:53:59.474557Z info tf Checking pods ready... 2025-08-04T19:53:59.474673Z info tf Checking pods ready... 2025-08-04T19:53:59.488986Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:02.690143Z info tf Checking pods ready... 2025-08-04T19:54:02.690231Z info tf Checking pods ready... 2025-08-04T19:54:02.695481Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:05.896254Z info tf Checking pods ready... 2025-08-04T19:54:05.896314Z info tf Checking pods ready... 2025-08-04T19:54:05.901600Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:09.102748Z info tf Checking pods ready... 2025-08-04T19:54:09.102804Z info tf Checking pods ready... 2025-08-04T19:54:09.379015Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:12.579779Z info tf Checking pods ready... 2025-08-04T19:54:12.579827Z info tf Checking pods ready... 2025-08-04T19:54:12.589161Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:15.789525Z info tf Checking pods ready... 2025-08-04T19:54:15.789583Z info tf Checking pods ready... 2025-08-04T19:54:15.798053Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:18.998215Z info tf Checking pods ready... 2025-08-04T19:54:18.998272Z info tf Checking pods ready... 2025-08-04T19:54:19.002568Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:22.203238Z info tf Checking pods ready... 2025-08-04T19:54:22.203389Z info tf Checking pods ready... 2025-08-04T19:54:22.207946Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:25.408214Z info tf Checking pods ready... 2025-08-04T19:54:25.408329Z info tf Checking pods ready... 2025-08-04T19:54:25.412926Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:28.613054Z info tf Checking pods ready... 2025-08-04T19:54:28.613090Z info tf Checking pods ready... 2025-08-04T19:54:28.618734Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:29.733671Z error port forward failed: lost connection to pod 2025-08-04T19:54:29.936914Z error port forward failed: lost connection to pod 2025-08-04T19:54:30.094426Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:54:30.180337Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:54:30.364676Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:54:30.433898Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:54:31.818881Z info tf Checking pods ready... 2025-08-04T19:54:31.818947Z info tf Checking pods ready... 2025-08-04T19:54:31.823014Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:35.023643Z info tf Checking pods ready... 2025-08-04T19:54:35.023790Z info tf Checking pods ready... 2025-08-04T19:54:35.028402Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:38.229450Z info tf Checking pods ready... 2025-08-04T19:54:38.229527Z info tf Checking pods ready... 2025-08-04T19:54:38.234753Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:41.435534Z info tf Checking pods ready... 2025-08-04T19:54:41.435580Z info tf Checking pods ready... 2025-08-04T19:54:41.440976Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:44.642089Z info tf Checking pods ready... 2025-08-04T19:54:44.642129Z info tf Checking pods ready... 2025-08-04T19:54:44.646511Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:45.464618Z error port forward failed: lost connection to pod 2025-08-04T19:54:45.886397Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:54:45.956494Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:54:47.846622Z info tf Checking pods ready... 2025-08-04T19:54:47.846690Z info tf Checking pods ready... 2025-08-04T19:54:47.850784Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:51.051881Z info tf Checking pods ready... 2025-08-04T19:54:51.051928Z info tf Checking pods ready... 2025-08-04T19:54:51.058528Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:54.258940Z info tf Checking pods ready... 2025-08-04T19:54:54.258986Z info tf Checking pods ready... 2025-08-04T19:54:54.263218Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:57.464251Z info tf Checking pods ready... 2025-08-04T19:54:57.464292Z info tf Checking pods ready... 2025-08-04T19:54:57.468860Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:58.112824Z error port forward failed: lost connection to pod 2025-08-04T19:54:58.537234Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:54:58.605742Z error port forward failed: lost connection to pod 2025-08-04T19:54:58.616979Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:54:58.631421Z error port forward failed: lost connection to pod 2025-08-04T19:54:59.020774Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:54:59.043412Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:54:59.084627Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:54:59.105882Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:55:00.670031Z info tf Checking pods ready... 2025-08-04T19:55:00.670101Z info tf Checking pods ready... 2025-08-04T19:55:00.678953Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:00.969356Z error port forward failed: lost connection to pod 2025-08-04T19:55:01.377008Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:55:01.451507Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:55:02.774697Z error port forward failed: lost connection to pod 2025-08-04T19:55:03.202671Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:55:03.268861Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:55:03.703857Z error port forward failed: lost connection to pod 2025-08-04T19:55:03.879479Z info tf Checking pods ready... 2025-08-04T19:55:03.879532Z info tf Checking pods ready... 2025-08-04T19:55:03.884118Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:04.121393Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:55:04.179771Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:55:07.084840Z info tf Checking pods ready... 2025-08-04T19:55:07.084919Z info tf Checking pods ready... 2025-08-04T19:55:07.088887Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:10.290011Z info tf Checking pods ready... 2025-08-04T19:55:10.290100Z info tf Checking pods ready... 2025-08-04T19:55:10.294210Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:13.495171Z info tf Checking pods ready... 2025-08-04T19:55:13.495233Z info tf Checking pods ready... 2025-08-04T19:55:13.499948Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:16.701021Z info tf Checking pods ready... 2025-08-04T19:55:16.701105Z info tf Checking pods ready... 2025-08-04T19:55:16.705052Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:19.905748Z info tf Checking pods ready... 2025-08-04T19:55:19.905838Z info tf Checking pods ready... 2025-08-04T19:55:19.913519Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:23.114421Z info tf Checking pods ready... 2025-08-04T19:55:23.114490Z info tf Checking pods ready... 2025-08-04T19:55:23.120089Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:26.321276Z info tf Checking pods ready... 2025-08-04T19:55:26.321354Z info tf Checking pods ready... 2025-08-04T19:55:26.330633Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:29.531582Z info tf Checking pods ready... 2025-08-04T19:55:29.531689Z info tf Checking pods ready... 2025-08-04T19:55:29.538285Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:32.738990Z info tf Checking pods ready... 2025-08-04T19:55:32.739046Z info tf Checking pods ready... 2025-08-04T19:55:32.743611Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:35.943827Z info tf Checking pods ready... 2025-08-04T19:55:35.943936Z info tf Checking pods ready... 2025-08-04T19:55:35.952952Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:36.185323Z error port forward failed: lost connection to pod 2025-08-04T19:55:36.438490Z error port forward failed: lost connection to pod 2025-08-04T19:55:36.594646Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:55:36.679485Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:55:36.864766Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:55:36.928631Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:55:39.154099Z info tf Checking pods ready... 2025-08-04T19:55:39.154172Z info tf Checking pods ready... 2025-08-04T19:55:39.158775Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:42.359655Z info tf Checking pods ready... 2025-08-04T19:55:42.359754Z info tf Checking pods ready... 2025-08-04T19:55:42.364417Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:45.565168Z info tf Checking pods ready... 2025-08-04T19:55:45.565209Z info tf Checking pods ready... 2025-08-04T19:55:45.570212Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:48.771325Z info tf Checking pods ready... 2025-08-04T19:55:48.771382Z info tf Checking pods ready... 2025-08-04T19:55:48.775198Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:51.963291Z error port forward failed: lost connection to pod 2025-08-04T19:55:51.975857Z info tf Checking pods ready... 2025-08-04T19:55:51.975917Z info tf Checking pods ready... 2025-08-04T19:55:51.980486Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:52.385393Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:55:52.449992Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:55:55.181433Z info tf Checking pods ready... 2025-08-04T19:55:55.181490Z info tf Checking pods ready... 2025-08-04T19:55:55.186221Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:58.386288Z info tf Checking pods ready... 2025-08-04T19:55:58.386335Z info tf Checking pods ready... 2025-08-04T19:55:58.392790Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:01.593315Z info tf Checking pods ready... 2025-08-04T19:56:01.593360Z info tf Checking pods ready... 2025-08-04T19:56:01.597418Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:04.628460Z error port forward failed: lost connection to pod 2025-08-04T19:56:04.798293Z info tf Checking pods ready... 2025-08-04T19:56:04.798379Z info tf Checking pods ready... 2025-08-04T19:56:04.803119Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:05.037669Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:56:05.089672Z error port forward failed: lost connection to pod 2025-08-04T19:56:05.106495Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:56:05.110208Z error port forward failed: lost connection to pod 2025-08-04T19:56:05.520075Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:56:05.543125Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:56:05.598517Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:56:05.628939Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:56:07.456329Z error port forward failed: lost connection to pod 2025-08-04T19:56:07.877261Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:56:07.960006Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:56:08.003325Z info tf Checking pods ready... 2025-08-04T19:56:08.003405Z info tf Checking pods ready... 2025-08-04T19:56:08.007640Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:09.273996Z error port forward failed: lost connection to pod 2025-08-04T19:56:09.701685Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:56:09.806894Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:56:10.185551Z error port forward failed: lost connection to pod 2025-08-04T19:56:10.621634Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:56:10.694953Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:56:11.207965Z info tf Checking pods ready... 2025-08-04T19:56:11.208045Z info tf Checking pods ready... 2025-08-04T19:56:11.212643Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:14.413189Z info tf Checking pods ready... 2025-08-04T19:56:14.413243Z info tf Checking pods ready... 2025-08-04T19:56:14.418225Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:17.618679Z info tf Checking pods ready... 2025-08-04T19:56:17.618772Z info tf Checking pods ready... 2025-08-04T19:56:17.624708Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:20.825916Z info tf Checking pods ready... 2025-08-04T19:56:20.826028Z info tf Checking pods ready... 2025-08-04T19:56:20.842903Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:24.043636Z info tf Checking pods ready... 2025-08-04T19:56:24.043775Z info tf Checking pods ready... 2025-08-04T19:56:24.048546Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:27.249093Z info tf Checking pods ready... 2025-08-04T19:56:27.249160Z info tf Checking pods ready... 2025-08-04T19:56:27.253561Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:30.454118Z info tf Checking pods ready... 2025-08-04T19:56:30.454220Z info tf Checking pods ready... 2025-08-04T19:56:30.462083Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:33.662864Z info tf Checking pods ready... 2025-08-04T19:56:33.662951Z info tf Checking pods ready... 2025-08-04T19:56:33.668119Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:36.868271Z info tf Checking pods ready... 2025-08-04T19:56:36.868352Z info tf Checking pods ready... 2025-08-04T19:56:36.873020Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:40.074081Z info tf Checking pods ready... 2025-08-04T19:56:40.074152Z info tf Checking pods ready... 2025-08-04T19:56:40.079492Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:42.683862Z error port forward failed: lost connection to pod 2025-08-04T19:56:42.932059Z error port forward failed: lost connection to pod 2025-08-04T19:56:43.094976Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:56:43.153857Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:56:43.280621Z info tf Checking pods ready... 2025-08-04T19:56:43.280695Z info tf Checking pods ready... 2025-08-04T19:56:43.284648Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:43.364679Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:56:43.442865Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:56:46.485041Z info tf Checking pods ready... 2025-08-04T19:56:46.485095Z info tf Checking pods ready... 2025-08-04T19:56:46.489188Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:49.690378Z info tf Checking pods ready... 2025-08-04T19:56:49.690454Z info tf Checking pods ready... 2025-08-04T19:56:49.695006Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:52.896145Z info tf Checking pods ready... 2025-08-04T19:56:52.896227Z info tf Checking pods ready... 2025-08-04T19:56:52.902391Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:56.103198Z info tf Checking pods ready... 2025-08-04T19:56:56.103281Z info tf Checking pods ready... 2025-08-04T19:56:56.107588Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:58.454973Z error port forward failed: lost connection to pod 2025-08-04T19:56:58.885939Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:56:58.959361Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:56:59.307991Z info tf Checking pods ready... 2025-08-04T19:56:59.308050Z info tf Checking pods ready... 2025-08-04T19:56:59.313243Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) tunneling_test.go:121: error getting external forward proxy ips: timeout while waiting after 190 attempts (last error: 1 error occurred: * external/external-forward-proxy-55d7b546bb-cmx2v: Pending ) 2025-08-04T19:57:01.911917Z info tf === DONE (failed): Test: 'pilot[TestTunnelingOutboundTraffic] (10m0.235059652s)' === --- FAIL: TestTunnelingOutboundTraffic (600.34s) FAIL tests/integration/pilot.TestTunnelingOutboundTraffic (600.34s) PASS tests/integration/pilot.TestEnsureNoMissingCRDs (0.00s) 2025-08-04T19:57:02.022022Z info tf === FAILED: Test Run: 'pilot' (exitCode: 1) === 2025-08-04T19:57:02.022036Z info tf === Suite "pilot" run time: 14m21.936318771s === 2025-08-04T19:57:02.022047Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T19:57:02.023633Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:57:02.023658Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:57:02.023713Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:57:02.150890Z warn tf Unable to get logs for cluster/pod/container: cluster-0/external/external-forward-proxy-55d7b546bb-cmx2v/external-forward-proxy for: container "external-forward-proxy" in pod "external-forward-proxy-55d7b546bb-cmx2v" is waiting to start: trying and failing to pull image 2025-08-04T19:57:02.351567Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Pending) 2025-08-04T19:57:02.413851Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:57:02Z/2975cd1bd89-9c16-4edd-a60c-54183431a78d 2025-08-04T19:57:02.414043Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3902s 2025-08-04T19:57:02.414744Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:57:02.547044Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:57:02Z/297c8717639-4356-4cef-a8f3-8b6b89f0d1d6 2025-08-04T19:57:02.547155Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5233s 2025-08-04T19:57:02.547942Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:57:02.696915Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:57:02Z/2970b8b3adb-d0d8-41ae-a403-c680da8edac2 2025-08-04T19:57:02.697087Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6732s 2025-08-04T19:57:02.698000Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:57:11.119429Z error port forward failed: lost connection to pod 2025-08-04T19:57:11.537645Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:57:11.595764Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:57:11.603671Z error port forward failed: lost connection to pod 2025-08-04T19:57:11.632392Z error port forward failed: lost connection to pod 2025-08-04T19:57:11.687693Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:57:11.687781Z info tf === SUCCEEDED: Cleanup Istio in 80.696µs [Suite=pilot] === FAIL tests/integration/pilot DONE 732 tests, 52 skipped, 20 failures in 968.485s exec: [go test -json -test.run=^TestJsonInputFile$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 834000 2025-08-04T19:57:29.498351Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:57:29.498467Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:57:29.535360Z info tf === Test Framework Settings === 2025-08-04T19:57:29.535458Z info tf TestID: pilot RunID: a7d82081-a492-46cc-9f46-ab3404a29361 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:57:29.535464Z info tf =============================== 2025-08-04T19:57:29.535813Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a7d82081a49246cc9f46ab340 2025-08-04T19:57:29.535897Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:57:29.535909Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:57:29.535928Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:57:29.535936Z info tf === BEGIN: Building clusters === 2025-08-04T19:57:29.539863Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:57:29.539870Z info tf === DONE: Building clusters === 2025-08-04T19:57:29.539894Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:57:29.539916Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:57:29.539922Z info tf === Istio Component Config === 2025-08-04T19:57:29.539951Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:57:29.539955Z info tf ================================ 2025-08-04T19:57:29.542110Z info tf skipping deployment as specified in the config 2025-08-04T19:57:29.542125Z info tf === SUCCEEDED: Deploy Istio in 2.203697ms [Suite=pilot]=== 2025-08-04T19:57:29.542241Z info tf === BEGIN: Create namespace external === 2025-08-04T19:57:29.542241Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:57:29.585274Z info tf === SUCCEEDED: Create namespace echo in 43.053148ms === 2025-08-04T19:57:29.591840Z info tf === SUCCEEDED: Create namespace external in 49.628425ms === 2025-08-04T19:57:29.867011Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:57:29.941307Z error tf === FAILED: Deploy echo instances === 2025-08-04T19:57:29.941362Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a7d82081a49246cc9f46ab340/_suite_context/ServiceAccount-Service.683416036.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T19:57:29.941421Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:57:29.941430Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:57:29.941446Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:57:30.261994Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:57:30.261989Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:57:30.332474Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:57:30Z/30311b9d97a-f86d-47aa-b305-fa590603fe7b 2025-08-04T19:57:30.332648Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3894s 2025-08-04T19:57:30.333503Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:57:30.600330Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:57:30Z/303e54126c3-4aa3-445d-aef4-2ab01f0933e4 2025-08-04T19:57:30.600539Z info tf istioctl ([x internal-debug --all configz]): completed after 0.6572s 2025-08-04T19:57:30.601446Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:57:30.787356Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:57:30Z/3036271b569-acf0-4d72-8ae3-e801f5dc21b6 2025-08-04T19:57:30.787473Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.8441s 2025-08-04T19:57:30.788109Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:57:37.513228Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/a-v1-6b586f9d47-dmjxt/istio-proxy for: pods "a-v1-6b586f9d47-dmjxt" not found 2025-08-04T19:57:37.517151Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/a-v1-6b586f9d47-dmjxt/istio-validation for: pods "a-v1-6b586f9d47-dmjxt" not found 2025-08-04T19:57:37.521436Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/b-v1-5bccd7df8d-xksft/app for: pods "b-v1-5bccd7df8d-xksft" not found 2025-08-04T19:57:37.525220Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/b-v1-5bccd7df8d-xksft/istio-proxy for: pods "b-v1-5bccd7df8d-xksft" not found 2025-08-04T19:57:37.528806Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/b-v1-5bccd7df8d-xksft/istio-validation for: pods "b-v1-5bccd7df8d-xksft" not found 2025-08-04T19:57:37.553246Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/c-v1-5f56c57bb9-nzfdl/app for: pods "c-v1-5f56c57bb9-nzfdl" not found 2025-08-04T19:57:37.557898Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/c-v1-5f56c57bb9-nzfdl/istio-proxy for: pods "c-v1-5f56c57bb9-nzfdl" not found 2025-08-04T19:57:37.561525Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/c-v1-5f56c57bb9-nzfdl/istio-validation for: pods "c-v1-5f56c57bb9-nzfdl" not found 2025-08-04T19:57:37.564428Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/headless-v1-5455bcc7b9-5hpbg/app for: pods "headless-v1-5455bcc7b9-5hpbg" not found 2025-08-04T19:57:37.570867Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/headless-v1-5455bcc7b9-5hpbg/istio-proxy for: pods "headless-v1-5455bcc7b9-5hpbg" not found 2025-08-04T19:57:37.574923Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/headless-v1-5455bcc7b9-5hpbg/istio-validation for: pods "headless-v1-5455bcc7b9-5hpbg" not found 2025-08-04T19:57:37.578076Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/sotw-v1-c494d6b8d-st2kk/app for: pods "sotw-v1-c494d6b8d-st2kk" not found 2025-08-04T19:57:37.581244Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/sotw-v1-c494d6b8d-st2kk/istio-proxy for: pods "sotw-v1-c494d6b8d-st2kk" not found 2025-08-04T19:57:37.585550Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/sotw-v1-c494d6b8d-st2kk/istio-validation for: pods "sotw-v1-c494d6b8d-st2kk" not found 2025-08-04T19:57:37.589355Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a7d82081a49246cc9f46ab340/_suite_context/ServiceAccount-Service.683416036.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T19:57:37.589394Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a7d82081a49246cc9f46ab340/_suite_context/ServiceAccount-Service.683416036.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-08-04T19:57:37.589403Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a7d82081a49246cc9f46ab340/_suite_context/ServiceAccount-Service.683416036.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T19:57:37.589459Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:57:37.589464Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:57:37.589496Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:57:37.610646Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:57:37.610770Z info tf === SUCCEEDED: Cleanup Istio in 111.419µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestJsonOutput$/^no_other_output_except_analysis_json_output$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 835553 2025-08-04T19:57:48.787684Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:57:48.787741Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:57:48.838802Z info tf === Test Framework Settings === 2025-08-04T19:57:48.838916Z info tf TestID: pilot RunID: 9710da97-e6e0-40fa-8036-505c5db0902a NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:57:48.838924Z info tf =============================== 2025-08-04T19:57:48.839163Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-9710da97e6e040fa8036505c5 2025-08-04T19:57:48.839279Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:57:48.839299Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:57:48.839328Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:57:48.839343Z info tf === BEGIN: Building clusters === 2025-08-04T19:57:48.846385Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:57:48.846435Z info tf === DONE: Building clusters === 2025-08-04T19:57:48.846456Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:57:48.846484Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:57:48.846494Z info tf === Istio Component Config === 2025-08-04T19:57:48.846534Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:57:48.846539Z info tf ================================ 2025-08-04T19:57:48.849036Z info tf skipping deployment as specified in the config 2025-08-04T19:57:48.849052Z info tf === SUCCEEDED: Deploy Istio in 2.56353ms [Suite=pilot]=== 2025-08-04T19:57:48.849154Z info tf === BEGIN: Create namespace external === 2025-08-04T19:57:48.849165Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:57:48.872569Z info tf === SUCCEEDED: Create namespace external in 23.405906ms === 2025-08-04T19:57:48.922391Z info tf === SUCCEEDED: Create namespace echo in 73.2388ms === 2025-08-04T19:57:49.105684Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:57:49.865896Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:49.911953Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:49.917868Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:49.966145Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:49.966182Z info klog Caches are synced controller=echo 2025-08-04T19:57:49.981027Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:49.982192Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:49.993768Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:49.996212Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:50.012160Z info klog Caches are synced controller=echo 2025-08-04T19:57:50.018743Z info klog Caches are synced controller=echo 2025-08-04T19:57:50.032910Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:57:50.067340Z info klog Caches are synced controller=echo 2025-08-04T19:57:50.082001Z info klog Caches are synced controller=echo 2025-08-04T19:57:50.083358Z info klog Caches are synced controller=echo 2025-08-04T19:57:50.094756Z info klog Caches are synced controller=echo 2025-08-04T19:57:50.097173Z info klog Caches are synced controller=echo 2025-08-04T19:57:50.133011Z info klog Caches are synced controller=echo 2025-08-04T19:58:02.790345Z info tf === SUCCEEDED: Deploy echo instances in 13.684646009s === 2025-08-04T19:58:02.823092Z info tf === DONE: Setup: 'pilot' (13.976624531s) === 2025-08-04T19:58:02.823126Z info tf === BEGIN: Test Run: 'pilot' === PASS tests/integration/pilot.TestJsonOutput/no_other_output_except_analysis_json_output (re-run 1) (0.53s) PASS tests/integration/pilot.TestJsonOutput (re-run 1) (0.56s) 2025-08-04T19:58:03.381083Z info tf === DONE: Test Run: 'pilot' === 2025-08-04T19:58:03.381106Z info tf === Suite "pilot" run time: 14.534654284s === 2025-08-04T19:58:03.381124Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T19:58:03.402054Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:58:03.402119Z info tf === SUCCEEDED: Cleanup Istio in 61.847µs [Suite=pilot] === PASS tests/integration/pilot exec: [go test -json -test.run=^TestKubeOnly$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 836849 2025-08-04T19:58:15.129242Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:58:15.129302Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:58:15.162392Z info tf === Test Framework Settings === 2025-08-04T19:58:15.162947Z info tf TestID: pilot RunID: 96ff8721-5831-4d3f-ae64-4eb42311aa75 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:58:15.163025Z info tf =============================== 2025-08-04T19:58:15.163310Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-96ff872158314d3fae644eb42 2025-08-04T19:58:15.163873Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:58:15.163983Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:58:15.164014Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:58:15.164149Z info tf === BEGIN: Building clusters === 2025-08-04T19:58:15.171088Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:58:15.171106Z info tf === DONE: Building clusters === 2025-08-04T19:58:15.171136Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:58:15.171174Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:58:15.171183Z info tf === Istio Component Config === 2025-08-04T19:58:15.171234Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:58:15.171242Z info tf ================================ 2025-08-04T19:58:15.174332Z info tf skipping deployment as specified in the config 2025-08-04T19:58:15.174350Z info tf === SUCCEEDED: Deploy Istio in 3.171842ms [Suite=pilot]=== 2025-08-04T19:58:15.174454Z info tf === BEGIN: Create namespace external === 2025-08-04T19:58:15.174453Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:58:15.205150Z info tf === SUCCEEDED: Create namespace echo in 30.70926ms === 2025-08-04T19:58:15.206406Z info tf === SUCCEEDED: Create namespace external in 31.966562ms === 2025-08-04T19:58:15.348416Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:58:15.381996Z error tf === FAILED: Deploy echo instances === 2025-08-04T19:58:15.382032Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-96ff872158314d3fae644eb42/_suite_context/Service.2857505158.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T19:58:15.382108Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:58:15.382125Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:58:15.382136Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:58:15.654027Z error klog an error occurred forwarding 42907 -> 15020: error forwarding port 15020 to pod 7cbbd0b46f4e4be1666c278959bb973bcb5d4bd52e0b4b34800af5937983a9d3, uid : port forward into network namespace "/var/run/netns/57afbdcb-37f3-4ed7-841c-811ed5e913e5": failed to connect to localhost:15020 inside namespace 7cbbd0b46f4e4be1666c278959bb973bcb5d4bd52e0b4b34800af5937983a9d3: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:15.654151Z error klog an error occurred forwarding 35713 -> 15020: error forwarding port 15020 to pod 0131068e86a2dd8fd62a69a2fa0fb10243735b7f8f781f9440ffb065827ac806, uid : port forward into network namespace "/var/run/netns/bf590985-170f-4215-90b7-ef7ea1eb2999": failed to connect to localhost:15020 inside namespace 0131068e86a2dd8fd62a69a2fa0fb10243735b7f8f781f9440ffb065827ac806: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:15.655923Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-ktgvf for: Get "http://localhost:35713/debug/ndsz": EOF 2025-08-04T19:58:15.656056Z error port forward failed: lost connection to pod 2025-08-04T19:58:15.656067Z error port forward failed: lost connection to pod 2025-08-04T19:58:15.656128Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-qh7ts for: Get "http://localhost:42907/debug/ndsz": EOF 2025-08-04T19:58:15.657373Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-qh7ts for: Get "http://localhost:42907/stats/prometheus": dial tcp 127.0.0.1:42907: connect: connection refused 2025-08-04T19:58:15.657460Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-ktgvf for: Get "http://localhost:35713/stats/prometheus": dial tcp 127.0.0.1:35713: connect: connection refused 2025-08-04T19:58:15.664849Z error klog an error occurred forwarding 45415 -> 15020: error forwarding port 15020 to pod 959512670b92b86a11f17585cf247f85fba22298f796351697270ffcec4be9ac, uid : port forward into network namespace "/var/run/netns/28f6c5c7-275b-49eb-8849-8d705028f8f3": failed to connect to localhost:15020 inside namespace 959512670b92b86a11f17585cf247f85fba22298f796351697270ffcec4be9ac: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:15.666413Z error port forward failed: lost connection to pod 2025-08-04T19:58:15.666512Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-48gwt for: Get "http://localhost:45415/debug/ndsz": EOF 2025-08-04T19:58:15.667606Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-48gwt for: Get "http://localhost:45415/stats/prometheus": dial tcp 127.0.0.1:45415: connect: connection refused 2025-08-04T19:58:15.695516Z error klog an error occurred forwarding 32871 -> 15020: error forwarding port 15020 to pod 9d9d0a9fdcf5a057f1397d83f466b4bb761c565861f0f3988149701dce278e87, uid : port forward into network namespace "/var/run/netns/54f9e5a1-8af0-47c7-96e1-ddf31f1349ac": failed to connect to localhost:15020 inside namespace 9d9d0a9fdcf5a057f1397d83f466b4bb761c565861f0f3988149701dce278e87: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:15.695948Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:14Z/319b6a573c4-d3a2-4a25-b182-53d687390b71 2025-08-04T19:58:15.696209Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3137s 2025-08-04T19:58:15.696706Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:15.697048Z error port forward failed: lost connection to pod 2025-08-04T19:58:15.697108Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/statefulset-v1-0 for: Get "http://localhost:32871/debug/ndsz": EOF 2025-08-04T19:58:15.698316Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/statefulset-v1-0 for: Get "http://localhost:32871/stats/prometheus": dial tcp 127.0.0.1:32871: connect: connection refused 2025-08-04T19:58:15.729075Z error klog an error occurred forwarding 46015 -> 15020: error forwarding port 15020 to pod 623c3f56598d3fefa70c1bf6ed8f716b4634c7484b74c126428bb09e1876227c, uid : port forward into network namespace "/var/run/netns/29994f62-e50b-4a33-b1e5-4c5b050da2c5": failed to connect to localhost:15020 inside namespace 623c3f56598d3fefa70c1bf6ed8f716b4634c7484b74c126428bb09e1876227c: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:15.730936Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-7bgkl for: Get "http://localhost:46015/debug/ndsz": EOF 2025-08-04T19:58:15.730975Z error port forward failed: lost connection to pod 2025-08-04T19:58:15.731600Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-7bgkl for: Get "http://localhost:46015/stats/prometheus": dial tcp 127.0.0.1:46015: connect: connection refused 2025-08-04T19:58:15.830216Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:14Z/319ebf1a590-a43b-4f80-99da-aea92902426e 2025-08-04T19:58:15.830354Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4478s 2025-08-04T19:58:15.831129Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:15.870734Z error klog an error occurred forwarding 45261 -> 15020: error forwarding port 15020 to pod 24c184a3f3e4727a058fd5b090f6e81e53d4a90f27f4d7d26c1abeee2a70ea8c, uid : port forward into network namespace "/var/run/netns/b528c751-4a0e-41c0-93c5-c645af39e60d": failed to connect to localhost:15020 inside namespace 24c184a3f3e4727a058fd5b090f6e81e53d4a90f27f4d7d26c1abeee2a70ea8c: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:15.872418Z error port forward failed: lost connection to pod 2025-08-04T19:58:15.872491Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-qtx94 for: Get "http://localhost:45261/debug/ndsz": EOF 2025-08-04T19:58:15.873719Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-qtx94 for: Get "http://localhost:45261/stats/prometheus": dial tcp 127.0.0.1:45261: connect: connection refused 2025-08-04T19:58:15.873748Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:58:15.980415Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:14Z/319b11dac87-1c48-448c-afc8-0d9fbbdc8ba3 2025-08-04T19:58:15.980516Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5979s 2025-08-04T19:58:15.981252Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:16.092116Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/proxyless-grpc-v1-759745c5b9-hx67f/istio-proxy for: pods "proxyless-grpc-v1-759745c5b9-hx67f" not found 2025-08-04T19:58:16.096233Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/proxyless-grpc-v1-759745c5b9-hx67f/app for: pods "proxyless-grpc-v1-759745c5b9-hx67f" not found 2025-08-04T19:58:16.404931Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-96ff872158314d3fae644eb42/_suite_context/Service.2857505158.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T19:58:16.404984Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-96ff872158314d3fae644eb42/_suite_context/Service.2857505158.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-08-04T19:58:16.404990Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-96ff872158314d3fae644eb42/_suite_context/Service.2857505158.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T19:58:16.405026Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:58:16.405049Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:58:16.405079Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:58:16.636113Z error klog an error occurred forwarding 38129 -> 15020: error forwarding port 15020 to pod 0131068e86a2dd8fd62a69a2fa0fb10243735b7f8f781f9440ffb065827ac806, uid : port forward into network namespace "/var/run/netns/bf590985-170f-4215-90b7-ef7ea1eb2999": failed to connect to localhost:15020 inside namespace 0131068e86a2dd8fd62a69a2fa0fb10243735b7f8f781f9440ffb065827ac806: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:16.637853Z error port forward failed: lost connection to pod 2025-08-04T19:58:16.637865Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-ktgvf for: Get "http://localhost:38129/debug/ndsz": EOF 2025-08-04T19:58:16.639006Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-ktgvf for: Get "http://localhost:38129/stats/prometheus": dial tcp 127.0.0.1:38129: connect: connection refused 2025-08-04T19:58:16.691646Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:14Z/319c062a3bc-cc9c-4b01-8e30-da539dd52d6e 2025-08-04T19:58:16.691884Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2865s 2025-08-04T19:58:16.692716Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:16.709105Z error klog an error occurred forwarding 35087 -> 15020: error forwarding port 15020 to pod 7cbbd0b46f4e4be1666c278959bb973bcb5d4bd52e0b4b34800af5937983a9d3, uid : port forward into network namespace "/var/run/netns/57afbdcb-37f3-4ed7-841c-811ed5e913e5": failed to connect to localhost:15020 inside namespace 7cbbd0b46f4e4be1666c278959bb973bcb5d4bd52e0b4b34800af5937983a9d3: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:16.711722Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-qh7ts for: Get "http://localhost:35087/debug/ndsz": EOF 2025-08-04T19:58:16.711932Z error port forward failed: lost connection to pod 2025-08-04T19:58:16.713974Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-qh7ts for: Get "http://localhost:35087/stats/prometheus": dial tcp 127.0.0.1:35087: connect: connection refused 2025-08-04T19:58:16.741594Z error klog an error occurred forwarding 44109 -> 15020: error forwarding port 15020 to pod 24c184a3f3e4727a058fd5b090f6e81e53d4a90f27f4d7d26c1abeee2a70ea8c, uid : port forward into network namespace "/var/run/netns/b528c751-4a0e-41c0-93c5-c645af39e60d": failed to connect to localhost:15020 inside namespace 24c184a3f3e4727a058fd5b090f6e81e53d4a90f27f4d7d26c1abeee2a70ea8c: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:16.742689Z error klog an error occurred forwarding 44579 -> 15020: error forwarding port 15020 to pod 9d9d0a9fdcf5a057f1397d83f466b4bb761c565861f0f3988149701dce278e87, uid : port forward into network namespace "/var/run/netns/54f9e5a1-8af0-47c7-96e1-ddf31f1349ac": failed to connect to localhost:15020 inside namespace 9d9d0a9fdcf5a057f1397d83f466b4bb761c565861f0f3988149701dce278e87: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:16.743198Z error port forward failed: lost connection to pod 2025-08-04T19:58:16.743242Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-qtx94 for: Get "http://localhost:44109/debug/ndsz": EOF 2025-08-04T19:58:16.744442Z error port forward failed: lost connection to pod 2025-08-04T19:58:16.744521Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-qtx94 for: Get "http://localhost:44109/stats/prometheus": dial tcp 127.0.0.1:44109: connect: connection refused 2025-08-04T19:58:16.744512Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/statefulset-v1-0 for: Get "http://localhost:44579/debug/ndsz": EOF 2025-08-04T19:58:16.745612Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/statefulset-v1-0 for: Get "http://localhost:44579/stats/prometheus": dial tcp 127.0.0.1:44579: connect: connection refused 2025-08-04T19:58:16.748841Z error klog an error occurred forwarding 38969 -> 15020: error forwarding port 15020 to pod 959512670b92b86a11f17585cf247f85fba22298f796351697270ffcec4be9ac, uid : port forward into network namespace "/var/run/netns/28f6c5c7-275b-49eb-8849-8d705028f8f3": failed to connect to localhost:15020 inside namespace 959512670b92b86a11f17585cf247f85fba22298f796351697270ffcec4be9ac: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:16.750650Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-48gwt for: Get "http://localhost:38969/debug/ndsz": EOF 2025-08-04T19:58:16.750713Z error port forward failed: lost connection to pod 2025-08-04T19:58:16.751314Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-48gwt for: Get "http://localhost:38969/stats/prometheus": dial tcp 127.0.0.1:38969: connect: connection refused 2025-08-04T19:58:16.752653Z error klog an error occurred forwarding 46713 -> 15020: error forwarding port 15020 to pod 623c3f56598d3fefa70c1bf6ed8f716b4634c7484b74c126428bb09e1876227c, uid : port forward into network namespace "/var/run/netns/29994f62-e50b-4a33-b1e5-4c5b050da2c5": failed to connect to localhost:15020 inside namespace 623c3f56598d3fefa70c1bf6ed8f716b4634c7484b74c126428bb09e1876227c: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:16.760232Z error port forward failed: lost connection to pod 2025-08-04T19:58:16.760402Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-7bgkl for: Get "http://localhost:46713/debug/ndsz": EOF 2025-08-04T19:58:16.761806Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-7bgkl for: Get "http://localhost:46713/stats/prometheus": dial tcp 127.0.0.1:46713: connect: connection refused 2025-08-04T19:58:16.761835Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:58:16.844886Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:14Z/319abc5a8f0-013b-4660-a703-2bf4b3c7a981 2025-08-04T19:58:16.845006Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4396s 2025-08-04T19:58:16.845812Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:16.996519Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:14Z/31914709543-904b-47b7-a68f-d26e023b991c 2025-08-04T19:58:16.996693Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5912s 2025-08-04T19:58:16.997510Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:17.975445Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:58:17.975533Z info tf === SUCCEEDED: Cleanup Istio in 82.016µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestFileAndKubeCombined$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 838242 2025-08-04T19:58:29.199320Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:58:29.199369Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:58:29.230839Z info tf === Test Framework Settings === 2025-08-04T19:58:29.230998Z info tf TestID: pilot RunID: 14bcee6d-8412-465e-a3de-d2ca4ce43751 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:58:29.231009Z info tf =============================== 2025-08-04T19:58:29.231274Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-14bcee6d8412465ea3ded2ca4 2025-08-04T19:58:29.231376Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:58:29.231390Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:58:29.231413Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:58:29.231425Z info tf === BEGIN: Building clusters === 2025-08-04T19:58:29.236449Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:58:29.236458Z info tf === DONE: Building clusters === 2025-08-04T19:58:29.236475Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:58:29.236501Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:58:29.236506Z info tf === Istio Component Config === 2025-08-04T19:58:29.236542Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:58:29.236547Z info tf ================================ 2025-08-04T19:58:29.238820Z info tf skipping deployment as specified in the config 2025-08-04T19:58:29.238832Z info tf === SUCCEEDED: Deploy Istio in 2.32783ms [Suite=pilot]=== 2025-08-04T19:58:29.238889Z info tf === BEGIN: Create namespace external === 2025-08-04T19:58:29.238918Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:58:29.279616Z info tf === SUCCEEDED: Create namespace echo in 40.68718ms === 2025-08-04T19:58:29.292467Z info tf === SUCCEEDED: Create namespace external in 53.574986ms === 2025-08-04T19:58:29.436055Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:58:30.636393Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.636994Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.670824Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.675644Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.679864Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.694684Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.708866Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.722570Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.736822Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.737178Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.771702Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.776342Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.780900Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.784507Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:58:30.795690Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.809256Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.822681Z info klog Caches are synced controller=echo 2025-08-04T19:58:30.885517Z info klog Caches are synced controller=echo 2025-08-04T19:58:41.990539Z info tf === SUCCEEDED: Deploy echo instances in 12.554473943s === 2025-08-04T19:58:42.020153Z info tf === DONE: Setup: 'pilot' (12.783661408s) === 2025-08-04T19:58:42.020217Z info tf === BEGIN: Test Run: 'pilot' === PASS tests/integration/pilot.TestFileAndKubeCombined (re-run 1) (1.60s) 2025-08-04T19:58:43.617666Z info tf === DONE: Test Run: 'pilot' === 2025-08-04T19:58:43.617720Z info tf === Suite "pilot" run time: 14.381241971s === 2025-08-04T19:58:43.617742Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T19:58:43.664612Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:58:43.664675Z info tf === SUCCEEDED: Cleanup Istio in 57.646µs [Suite=pilot] === PASS tests/integration/pilot exec: [go test -json -test.run=^TestGatewayConformance$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 839416 2025-08-04T19:58:54.762438Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:58:54.762490Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:58:54.801215Z info tf === Test Framework Settings === 2025-08-04T19:58:54.801370Z info tf TestID: pilot RunID: 258107d4-94a0-477a-ad74-969bda41546b NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:58:54.801378Z info tf =============================== 2025-08-04T19:58:54.801646Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-258107d494a0477aad74969bd 2025-08-04T19:58:54.801759Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:58:54.801781Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:58:54.801805Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:58:54.801818Z info tf === BEGIN: Building clusters === 2025-08-04T19:58:54.808946Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:58:54.808999Z info tf === DONE: Building clusters === 2025-08-04T19:58:54.809029Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:58:54.809055Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:58:54.809061Z info tf === Istio Component Config === 2025-08-04T19:58:54.809093Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:58:54.809098Z info tf ================================ 2025-08-04T19:58:54.811396Z info tf skipping deployment as specified in the config 2025-08-04T19:58:54.811412Z info tf === SUCCEEDED: Deploy Istio in 2.352307ms [Suite=pilot]=== 2025-08-04T19:58:54.811488Z info tf === BEGIN: Create namespace external === 2025-08-04T19:58:54.811552Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:58:54.828986Z info tf === SUCCEEDED: Create namespace echo in 17.483015ms === 2025-08-04T19:58:54.832082Z info tf === SUCCEEDED: Create namespace external in 20.61034ms === 2025-08-04T19:58:54.899054Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:58:54.915013Z error tf === FAILED: Deploy echo instances === 2025-08-04T19:58:54.915106Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-258107d494a0477aad74969bd/_suite_context/Service.1307698533.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T19:58:54.915168Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:58:54.915184Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:58:54.915228Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:58:55.190952Z error klog an error occurred forwarding 42075 -> 15020: error forwarding port 15020 to pod 17ecfa5ed0d8e9ffeccdffc78ff4bc067ed14c75cdbabd5c1d38cc943ac3506e, uid : port forward into network namespace "/var/run/netns/8e4906be-7c25-45fe-89eb-bff341e9d0af": failed to connect to localhost:15020 inside namespace 17ecfa5ed0d8e9ffeccdffc78ff4bc067ed14c75cdbabd5c1d38cc943ac3506e: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:55.191085Z error klog an error occurred forwarding 43415 -> 15020: error forwarding port 15020 to pod 94c173390ae302a5a8fa9b78fc097f65c0df88c026dda59fdcea6f18e8f2c222, uid : port forward into network namespace "/var/run/netns/68bde2a4-3566-4349-89bb-c09b2f943e03": failed to connect to localhost:15020 inside namespace 94c173390ae302a5a8fa9b78fc097f65c0df88c026dda59fdcea6f18e8f2c222: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:55.192442Z error port forward failed: lost connection to pod 2025-08-04T19:58:55.192438Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-2v462 for: Get "http://localhost:42075/debug/ndsz": EOF 2025-08-04T19:58:55.192494Z error port forward failed: lost connection to pod 2025-08-04T19:58:55.192803Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/proxyless-grpc-v1-759745c5b9-xhdsc for: Get "http://localhost:43415/debug/ndsz": EOF 2025-08-04T19:58:55.193261Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-2v462 for: Get "http://localhost:42075/stats/prometheus": dial tcp 127.0.0.1:42075: connect: connection refused 2025-08-04T19:58:55.194051Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/proxyless-grpc-v1-759745c5b9-xhdsc for: Get "http://localhost:43415/stats/prometheus": dial tcp 127.0.0.1:43415: connect: connection refused 2025-08-04T19:58:55.214110Z error klog an error occurred forwarding 43775 -> 15020: error forwarding port 15020 to pod 8b39040a4797c20aac2be1494e48c73ddc7355b89f1eb85cec688266b15d0ac3, uid : port forward into network namespace "/var/run/netns/fd94f7c4-401f-415c-a829-0c0f92e1c752": failed to connect to localhost:15020 inside namespace 8b39040a4797c20aac2be1494e48c73ddc7355b89f1eb85cec688266b15d0ac3: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:55.215659Z error port forward failed: lost connection to pod 2025-08-04T19:58:55.215660Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-j2tzh for: Get "http://localhost:43775/debug/ndsz": EOF 2025-08-04T19:58:55.216344Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-j2tzh for: Get "http://localhost:43775/stats/prometheus": dial tcp 127.0.0.1:43775: connect: connection refused 2025-08-04T19:58:55.244176Z error klog an error occurred forwarding 43501 -> 15020: error forwarding port 15020 to pod 3ad05c49b61a8a096f4b8977707bc7cf8488467d7661e3a38e670d591e8a2396, uid : port forward into network namespace "/var/run/netns/6b616622-903b-44cd-ab18-0d05b9f24399": failed to connect to localhost:15020 inside namespace 3ad05c49b61a8a096f4b8977707bc7cf8488467d7661e3a38e670d591e8a2396: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:55.246004Z error port forward failed: lost connection to pod 2025-08-04T19:58:55.246237Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-dfq6f for: Get "http://localhost:43501/debug/ndsz": EOF 2025-08-04T19:58:55.247295Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-dfq6f for: Get "http://localhost:43501/stats/prometheus": dial tcp 127.0.0.1:43501: connect: connection refused 2025-08-04T19:58:55.265326Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:54Z/338184ade50-e49f-40be-8e4c-008dab18463e 2025-08-04T19:58:55.265527Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3500s 2025-08-04T19:58:55.266266Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:55.387704Z error klog an error occurred forwarding 46341 -> 15020: error forwarding port 15020 to pod fcd0f805651957e78a2d25074e0d0f1e69fecfa1694b7057f9963c452c15eace, uid : port forward into network namespace "/var/run/netns/469862e4-4788-4097-b640-76bcd57a9c09": failed to connect to localhost:15020 inside namespace fcd0f805651957e78a2d25074e0d0f1e69fecfa1694b7057f9963c452c15eace: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:55.389803Z error port forward failed: lost connection to pod 2025-08-04T19:58:55.389899Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-l5gcr for: Get "http://localhost:46341/debug/ndsz": EOF 2025-08-04T19:58:55.391168Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-l5gcr for: Get "http://localhost:46341/stats/prometheus": dial tcp 127.0.0.1:46341: connect: connection refused 2025-08-04T19:58:55.391705Z error klog an error occurred forwarding 37343 -> 15020: error forwarding port 15020 to pod 816f34085cabd5791a3b7696db38b1a925f347bd4d6e0ab13dc78c57102f721d, uid : port forward into network namespace "/var/run/netns/90b26d41-e850-44f8-807b-d70cc79681eb": failed to connect to localhost:15020 inside namespace 816f34085cabd5791a3b7696db38b1a925f347bd4d6e0ab13dc78c57102f721d: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:55.393479Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-zf6h8 for: Get "http://localhost:37343/debug/ndsz": EOF 2025-08-04T19:58:55.393522Z error port forward failed: lost connection to pod 2025-08-04T19:58:55.394297Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-zf6h8 for: Get "http://localhost:37343/stats/prometheus": dial tcp 127.0.0.1:37343: connect: connection refused 2025-08-04T19:58:55.394340Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:58:55.599978Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:54Z/338abeb2f36-ddb6-4ced-a15f-98ea848f2a9a 2025-08-04T19:58:55.600223Z info tf istioctl ([x internal-debug --all configz]): completed after 0.6847s 2025-08-04T19:58:55.601069Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:55.812683Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/statefulset-v1-0/app for: pods "statefulset-v1-0" not found 2025-08-04T19:58:55.836452Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:54Z/33827387e7f-f27b-422b-bc41-809d2ecc0772 2025-08-04T19:58:55.836610Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.9210s 2025-08-04T19:58:55.837271Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:55.852846Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/statefulset-v1-0/istio-proxy for: pods "statefulset-v1-0" not found 2025-08-04T19:58:55.866142Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/statefulset-v1-0/istio-validation for: pods "statefulset-v1-0" not found 2025-08-04T19:58:56.102754Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:58:56.114186Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-258107d494a0477aad74969bd/_suite_context/Service.1307698533.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T19:58:56.114271Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-258107d494a0477aad74969bd/_suite_context/Service.1307698533.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-08-04T19:58:56.114283Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-258107d494a0477aad74969bd/_suite_context/Service.1307698533.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T19:58:56.114335Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:58:56.114335Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:58:56.114352Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:58:56.354560Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("proxyless-grpc-v1-759745c5b9-xhdsc_echo") 2025-08-04T19:58:56.368477Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("naked-v1-5bf694c455-2j8xr_echo") 2025-08-04T19:58:56.370204Z error klog an error occurred forwarding 40385 -> 15020: error forwarding port 15020 to pod 816f34085cabd5791a3b7696db38b1a925f347bd4d6e0ab13dc78c57102f721d, uid : port forward into network namespace "/var/run/netns/90b26d41-e850-44f8-807b-d70cc79681eb": failed to connect to localhost:15020 inside namespace 816f34085cabd5791a3b7696db38b1a925f347bd4d6e0ab13dc78c57102f721d: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:56.370335Z error klog an error occurred forwarding 37215 -> 15020: error forwarding port 15020 to pod 8b39040a4797c20aac2be1494e48c73ddc7355b89f1eb85cec688266b15d0ac3, uid : port forward into network namespace "/var/run/netns/fd94f7c4-401f-415c-a829-0c0f92e1c752": failed to connect to localhost:15020 inside namespace 8b39040a4797c20aac2be1494e48c73ddc7355b89f1eb85cec688266b15d0ac3: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:56.371805Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-zf6h8 for: Get "http://localhost:40385/debug/ndsz": EOF 2025-08-04T19:58:56.371817Z error port forward failed: lost connection to pod 2025-08-04T19:58:56.371894Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-j2tzh for: Get "http://localhost:37215/debug/ndsz": EOF 2025-08-04T19:58:56.371906Z error port forward failed: lost connection to pod 2025-08-04T19:58:56.372598Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-zf6h8 for: Get "http://localhost:40385/stats/prometheus": dial tcp 127.0.0.1:40385: connect: connection refused 2025-08-04T19:58:56.372586Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-j2tzh for: Get "http://localhost:37215/stats/prometheus": dial tcp 127.0.0.1:37215: connect: connection refused 2025-08-04T19:58:56.374923Z error klog an error occurred forwarding 45993 -> 15020: error forwarding port 15020 to pod fcd0f805651957e78a2d25074e0d0f1e69fecfa1694b7057f9963c452c15eace, uid : port forward into network namespace "/var/run/netns/469862e4-4788-4097-b640-76bcd57a9c09": failed to connect to localhost:15020 inside namespace fcd0f805651957e78a2d25074e0d0f1e69fecfa1694b7057f9963c452c15eace: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:56.376624Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-l5gcr for: Get "http://localhost:45993/debug/ndsz": EOF 2025-08-04T19:58:56.376627Z error port forward failed: lost connection to pod 2025-08-04T19:58:56.377206Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-l5gcr for: Get "http://localhost:45993/stats/prometheus": dial tcp 127.0.0.1:45993: connect: connection refused 2025-08-04T19:58:56.388171Z error klog an error occurred forwarding 33107 -> 15020: error forwarding port 15020 to pod 3ad05c49b61a8a096f4b8977707bc7cf8488467d7661e3a38e670d591e8a2396, uid : port forward into network namespace "/var/run/netns/6b616622-903b-44cd-ab18-0d05b9f24399": failed to connect to localhost:15020 inside namespace 3ad05c49b61a8a096f4b8977707bc7cf8488467d7661e3a38e670d591e8a2396: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:56.389578Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-dfq6f for: Get "http://localhost:33107/debug/ndsz": EOF 2025-08-04T19:58:56.389679Z error port forward failed: lost connection to pod 2025-08-04T19:58:56.390304Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-dfq6f for: Get "http://localhost:33107/stats/prometheus": dial tcp 127.0.0.1:33107: connect: connection refused 2025-08-04T19:58:56.395014Z error klog an error occurred forwarding 36589 -> 15020: error forwarding port 15020 to pod 17ecfa5ed0d8e9ffeccdffc78ff4bc067ed14c75cdbabd5c1d38cc943ac3506e, uid : port forward into network namespace "/var/run/netns/8e4906be-7c25-45fe-89eb-bff341e9d0af": failed to connect to localhost:15020 inside namespace 17ecfa5ed0d8e9ffeccdffc78ff4bc067ed14c75cdbabd5c1d38cc943ac3506e: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T19:58:56.396731Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-2v462 for: Get "http://localhost:36589/debug/ndsz": EOF 2025-08-04T19:58:56.396819Z error port forward failed: lost connection to pod 2025-08-04T19:58:56.397372Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-2v462 for: Get "http://localhost:36589/stats/prometheus": dial tcp 127.0.0.1:36589: connect: connection refused 2025-08-04T19:58:56.421815Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:55Z/3404a88d453-bef7-4211-9eb0-9608bc61017a 2025-08-04T19:58:56.422045Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3075s 2025-08-04T19:58:56.422660Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:56.499867Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("proxyless-grpc-v1-759745c5b9-xhdsc_echo") 2025-08-04T19:58:56.501113Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("naked-v1-5bf694c455-2j8xr_echo") 2025-08-04T19:58:56.611357Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:55Z/3403e00db27-10cb-47e9-87ad-a44d3118e88f 2025-08-04T19:58:56.611501Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4969s 2025-08-04T19:58:56.612056Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:56.644070Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("naked-v1-5bf694c455-2j8xr_echo") 2025-08-04T19:58:56.673750Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("proxyless-grpc-v1-759745c5b9-xhdsc_echo") 2025-08-04T19:58:56.775052Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("naked-v1-5bf694c455-2j8xr_echo") 2025-08-04T19:58:56.784465Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:58:55Z/34068417a6f-9087-4165-b4e9-a6769e2b1a49 2025-08-04T19:58:56.784606Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6700s 2025-08-04T19:58:56.785377Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:58:56.809152Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("proxyless-grpc-v1-759745c5b9-xhdsc_echo") 2025-08-04T19:58:56.871234Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("naked-v1-5bf694c455-2j8xr_echo") 2025-08-04T19:58:56.928803Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("proxyless-grpc-v1-759745c5b9-xhdsc_echo") 2025-08-04T19:58:56.939553Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: port forward: error upgrading connection: unable to upgrade connection: pod not found ("naked-v1-5bf694c455-2j8xr_echo")) 2025-08-04T19:58:57.013387Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:58:57.013493Z info tf === SUCCEEDED: Cleanup Istio in 96.525µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^unmanaged$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 840892 2025-08-04T19:59:10.969979Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:59:10.970056Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:59:11.020794Z info tf === Test Framework Settings === 2025-08-04T19:59:11.020960Z info tf TestID: pilot RunID: 82f8b692-94d5-4b9d-8041-c4b0dcb9aaf0 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:59:11.020971Z info tf =============================== 2025-08-04T19:59:11.021250Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-82f8b69294d54b9d8041c4b0d 2025-08-04T19:59:11.021378Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:59:11.021401Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:59:11.021432Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:59:11.021446Z info tf === BEGIN: Building clusters === 2025-08-04T19:59:11.027943Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:59:11.028001Z info tf === DONE: Building clusters === 2025-08-04T19:59:11.028032Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:59:11.028066Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:59:11.028071Z info tf === Istio Component Config === 2025-08-04T19:59:11.028102Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:59:11.028107Z info tf ================================ 2025-08-04T19:59:11.030512Z info tf skipping deployment as specified in the config 2025-08-04T19:59:11.030531Z info tf === SUCCEEDED: Deploy Istio in 2.457731ms [Suite=pilot]=== 2025-08-04T19:59:11.030607Z info tf === BEGIN: Create namespace external === 2025-08-04T19:59:11.030644Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:59:11.082920Z info tf === SUCCEEDED: Create namespace echo in 52.25692ms === 2025-08-04T19:59:11.087826Z info tf === SUCCEEDED: Create namespace external in 57.236272ms === 2025-08-04T19:59:11.343082Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:59:12.697906Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.722243Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.741843Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.754055Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.797128Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.797908Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.798083Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.822993Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.842829Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.846531Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.851978Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.852995Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:12.854999Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.898003Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.898071Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.947106Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.952773Z info klog Caches are synced controller=echo 2025-08-04T19:59:12.953146Z info klog Caches are synced controller=echo 2025-08-04T19:59:22.459515Z info tf === SUCCEEDED: Deploy echo instances in 11.116426938s === 2025-08-04T19:59:22.494117Z info tf === DONE: Setup: 'pilot' (11.466069803s) === 2025-08-04T19:59:22.494180Z info tf === BEGIN: Test Run: 'pilot' === === RUN TestGateway/unmanaged 2025-08-04T19:59:22.494952Z info tf === BEGIN: Test: 'pilot[TestGateway/unmanaged]' === gateway_test.go:621: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-82f8b69294d54b9d8041c4b0d/TestGateway/unmanaged/_test_context/GatewayClass-Gateway.4225568805.yaml] to ns in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:59:22.547096Z info tf === DONE (failed): Test: 'pilot[TestGateway/unmanaged] (52.139072ms)' === 2025-08-04T19:59:22.547200Z error tf === Dumping Namespace echo State for TestGateway/unmanaged... 2025-08-04T19:59:22.547225Z error tf === Dumping Istio Deployment State for TestGateway/unmanaged... 2025-08-04T19:59:22.547236Z error tf === Dumping Namespace external State for TestGateway/unmanaged... 2025-08-04T19:59:22.814123Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35627bc8ab8-6a5a-4e84-83af-25fd4251de24 2025-08-04T19:59:22.814294Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2668s 2025-08-04T19:59:22.814792Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:22.953454Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35634b9db82-31dd-4ab0-b7d5-256bafaff75a 2025-08-04T19:59:22.953566Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4061s 2025-08-04T19:59:22.954237Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:23.094638Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/356d3bb7de4-99f6-4d1c-9bd4-786ca033ee88 2025-08-04T19:59:23.094806Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5473s 2025-08-04T19:59:23.095624Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:23.400775Z warn tf cluster/pod cluster-0/echo/statefulset-v1-0 found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:23.426634Z warn tf cluster/pod cluster-0/echo/c-v1-5f56c57bb9-p2gcj found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:23.500995Z warn tf cluster/pod cluster-0/echo/b-v1-5bccd7df8d-rpfkw found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:23.572821Z warn tf cluster/pod cluster-0/echo/a-v1-6b586f9d47-mt2cn found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:25.185638Z error tf === Dumping Namespace istio-system State for TestGateway/unmanaged... --- FAIL: TestGateway/unmanaged (3.34s) FAIL tests/integration/pilot.TestGateway/unmanaged (re-run 1) (3.34s) === RUN TestGateway 2025-08-04T19:59:22.494733Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T19:59:25.836823Z info tf === DONE (failed): Test: 'pilot[TestGateway] (3.342083969s)' === 2025-08-04T19:59:25.836927Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T19:59:25.836927Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T19:59:25.836945Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T19:59:26.170177Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35688c494e0-250f-464e-a469-af742b29ad70 2025-08-04T19:59:26.170368Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3331s 2025-08-04T19:59:26.171214Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:26.301652Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/356a94b3cdd-9d44-4611-bc9c-b41130d4a788 2025-08-04T19:59:26.301829Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4646s 2025-08-04T19:59:26.302638Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:26.456733Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/3565ec10ec5-1f39-4a4c-a9aa-5237594751c5 2025-08-04T19:59:26.456872Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.6196s 2025-08-04T19:59:26.457694Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway (4.34s) FAIL tests/integration/pilot.TestGateway (re-run 1) (4.34s) 2025-08-04T19:59:26.839475Z info tf === FAILED: Test Run: 'pilot' (exitCode: 1) === 2025-08-04T19:59:26.839547Z info tf === Suite "pilot" run time: 15.811524316s === 2025-08-04T19:59:26.839572Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T19:59:26.839887Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:59:26.839900Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:59:26.839914Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:59:27.195597Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35681e71189-13d4-408b-8d4f-76e9cb14d1ca 2025-08-04T19:59:27.195830Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3557s 2025-08-04T19:59:27.196496Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:27.342718Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35608cbdfdd-b393-441b-844b-8da0bf520cb2 2025-08-04T19:59:27.342851Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5027s 2025-08-04T19:59:27.343720Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:27.469226Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/3560ad8d0d9-1dfb-4d81-896a-4bb4d44c7c6d 2025-08-04T19:59:27.469377Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6292s 2025-08-04T19:59:27.469937Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:27.877454Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:59:27.877544Z info tf === SUCCEEDED: Cleanup Istio in 82.072µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^managed$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 842206 2025-08-04T19:59:41.065668Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:59:41.065753Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:59:41.110653Z info tf === Test Framework Settings === 2025-08-04T19:59:41.110811Z info tf TestID: pilot RunID: 47e35651-f465-4671-9c66-109c9e7631b3 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:59:41.110820Z info tf =============================== 2025-08-04T19:59:41.111042Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-47e35651f46546719c66109c9 2025-08-04T19:59:41.111165Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:59:41.111184Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:59:41.111210Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:59:41.111222Z info tf === BEGIN: Building clusters === 2025-08-04T19:59:41.117628Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:59:41.117688Z info tf === DONE: Building clusters === 2025-08-04T19:59:41.117720Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:59:41.117750Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:59:41.117757Z info tf === Istio Component Config === 2025-08-04T19:59:41.117796Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:59:41.117802Z info tf ================================ 2025-08-04T19:59:41.120172Z info tf skipping deployment as specified in the config 2025-08-04T19:59:41.120188Z info tf === SUCCEEDED: Deploy Istio in 2.432397ms [Suite=pilot]=== 2025-08-04T19:59:41.120268Z info tf === BEGIN: Create namespace external === 2025-08-04T19:59:41.120273Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:59:41.142126Z info tf === SUCCEEDED: Create namespace echo in 21.854899ms === 2025-08-04T19:59:41.150532Z info tf === SUCCEEDED: Create namespace external in 30.274943ms === 2025-08-04T19:59:41.264605Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:59:41.316919Z error tf === FAILED: Deploy echo instances === 2025-08-04T19:59:41.316973Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-47e35651f46546719c66109c9/_suite_context/ServiceAccount-Service.1264698613.yaml] to ns echo in cluster cluster-0: apply: patch: services "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T19:59:41.317029Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:59:41.317037Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:59:41.317077Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:59:41.576810Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:41.578037Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:41.583299Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:41.590208Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:41.591198Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:41.591667Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:41.599440Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:41.614742Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:41.615661Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:41.626831Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:41.722557Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:41.730529Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:41.730529Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:41.730745Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:41Z/359209513af-feaa-456f-a932-4f2aff63184c 2025-08-04T19:59:41.730834Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4135s 2025-08-04T19:59:41.731567Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:41.748068Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:41.755558Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:41.773644Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:41.773721Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:41.794295Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:41.813953Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:41.874512Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:41.933804Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:41.937294Z warn tf cluster/pod cluster-0/istio-system/istio-ingressgateway-b7b89b8d5-htcb9 found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:41.937750Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:41.956155Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:41.960100Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:41.969610Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:41.969844Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:41.974069Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:41.992082Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:41.999651Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.012305Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.085637Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.095018Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:41Z/35986fdd663-1e1e-4b8a-b546-fc705a2ebccb 2025-08-04T19:59:42.095520Z info tf istioctl ([x internal-debug --all configz]): completed after 0.7781s 2025-08-04T19:59:42.097714Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:42.115860Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.120225Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.133554Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.135613Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.139308Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.140066Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.140818Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.169616Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.174150Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.204936Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.236903Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.247789Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.250222Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.272171Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.272585Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.277094Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.283180Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.287669Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.298403Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: port forward: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo")) 2025-08-04T19:59:42.303226Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.314466Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: port forward: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo")) 2025-08-04T19:59:42.332191Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-47e35651f46546719c66109c9/_suite_context/ServiceAccount-Service.1264698613.yaml] to ns echo in cluster cluster-0: apply: patch: services "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T19:59:42.332267Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-47e35651f46546719c66109c9/_suite_context/ServiceAccount-Service.1264698613.yaml] to ns echo in cluster cluster-0: apply: patch: services "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-08-04T19:59:42.332279Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-47e35651f46546719c66109c9/_suite_context/ServiceAccount-Service.1264698613.yaml] to ns echo in cluster cluster-0: apply: patch: services "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T19:59:42.332314Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T19:59:42.332331Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T19:59:42.332379Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T19:59:42.373375Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:41Z/359705d7524-769c-47d2-b37d-b33fe72e5e65 2025-08-04T19:59:42.373579Z info tf istioctl ([x internal-debug --all clusterz]): completed after 1.0562s 2025-08-04T19:59:42.374155Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:42.582375Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.607140Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.630822Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.631436Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.653347Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.670403Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.701888Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.701888Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.701889Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.708752Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.784854Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.796135Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.824497Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-rpfkw_echo") 2025-08-04T19:59:42.842117Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:41Z/3599255a6bb-8553-4235-a339-107e2bea20f4 2025-08-04T19:59:42.842278Z info tf istioctl ([x internal-debug --all configz]): completed after 0.5097s 2025-08-04T19:59:42.842958Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:42.850763Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:42.854489Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.864544Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.866347Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.876084Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:42.876323Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-p2gcj_echo") 2025-08-04T19:59:42.894296Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:42.976786Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:43.004715Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-hjjbl_echo") 2025-08-04T19:59:43.015699Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:43.033259Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:43.043501Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-c46db_echo") 2025-08-04T19:59:43.086661Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:43.104153Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:41Z/359836aea23-1362-4fbb-942d-0f6152229d00 2025-08-04T19:59:43.104301Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.7717s 2025-08-04T19:59:43.105090Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:43.118072Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:43.162073Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:59:43.196681Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-mt2cn_echo") 2025-08-04T19:59:43.226882Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T19:59:43.264849Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T19:59:43.264908Z info tf === SUCCEEDED: Cleanup Istio in 54.988µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^tagged/gateway-connectivity-tagged-tag$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 843545 2025-08-04T19:59:57.200384Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:59:57.200449Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T19:59:57.238789Z info tf === Test Framework Settings === 2025-08-04T19:59:57.238904Z info tf TestID: pilot RunID: 10e8c027-f7fb-402c-9861-aa4db77be7ae NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T19:59:57.238910Z info tf =============================== 2025-08-04T19:59:57.239047Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-10e8c027f7fb402c9861aa4db 2025-08-04T19:59:57.239112Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T19:59:57.239125Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T19:59:57.239142Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T19:59:57.239151Z info tf === BEGIN: Building clusters === 2025-08-04T19:59:57.243599Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T19:59:57.243609Z info tf === DONE: Building clusters === 2025-08-04T19:59:57.243631Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T19:59:57.243653Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T19:59:57.243659Z info tf === Istio Component Config === 2025-08-04T19:59:57.243688Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T19:59:57.243692Z info tf ================================ 2025-08-04T19:59:57.245888Z info tf skipping deployment as specified in the config 2025-08-04T19:59:57.245902Z info tf === SUCCEEDED: Deploy Istio in 2.245307ms [Suite=pilot]=== 2025-08-04T19:59:57.245984Z info tf === BEGIN: Create namespace external === 2025-08-04T19:59:57.246043Z info tf === BEGIN: Create namespace echo === 2025-08-04T19:59:57.274050Z info tf === SUCCEEDED: Create namespace external in 28.046268ms === 2025-08-04T19:59:57.285143Z info tf === SUCCEEDED: Create namespace echo in 39.071932ms === 2025-08-04T19:59:57.429362Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:59:58.245153Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.249302Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.249360Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.295434Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.307684Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.308132Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.308384Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.318521Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.344634Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:59:58.346126Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.350061Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.350080Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.396146Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.409008Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.409008Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.409023Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.418892Z info klog Caches are synced controller=echo 2025-08-04T19:59:58.445753Z info klog Caches are synced controller=echo 2025-08-04T20:00:09.515030Z info tf === SUCCEEDED: Deploy echo instances in 12.08565482s === 2025-08-04T20:00:09.550798Z info tf === DONE: Setup: 'pilot' (12.307150445s) === 2025-08-04T20:00:09.550853Z info tf === BEGIN: Test Run: 'pilot' === === RUN TestGateway/tagged 2025-08-04T20:00:09.556368Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged]' === 2025-08-04T20:00:09.585734Z info tf istioctl ([tag set tag --revision default]): completed after 0.0293s 2025-08-04T20:00:09.585828Z info tf istioctl error: Error: revision tag "tag" already exists, and --overwrite is false kube.go:122: Unwanted exception for 'istioctl tag set tag --revision default': revision tag "tag" already exists, and --overwrite is false kube.go:123: Output: kube.go:124: Error: Error: revision tag "tag" already exists, and --overwrite is false 2025-08-04T20:00:09.585972Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged] (29.597988ms)' === 2025-08-04T20:00:09.586047Z error tf === Dumping Namespace echo State for TestGateway/tagged... 2025-08-04T20:00:09.586047Z error tf === Dumping Namespace external State for TestGateway/tagged... 2025-08-04T20:00:09.586047Z error tf === Dumping Istio Deployment State for TestGateway/tagged... 2025-08-04T20:00:10.031711Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/37040a4b32d-ea27-4fd9-8461-237c0bcce1ed 2025-08-04T20:00:10.031953Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4452s 2025-08-04T20:00:10.032856Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:10.164250Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/370cf37c6b0-0ffb-4f57-9c80-b923d81e27d2 2025-08-04T20:00:10.164453Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5777s 2025-08-04T20:00:10.165324Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:10.324634Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/370ca5eff81-60d4-4768-b807-c77f3d7b0cf1 2025-08-04T20:00:10.324905Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.7381s 2025-08-04T20:00:10.325769Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway/tagged (1.18s) FAIL tests/integration/pilot.TestGateway/tagged (re-run 1) (1.18s) === RUN TestGateway 2025-08-04T20:00:09.554173Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:00:10.737174Z info tf === DONE (failed): Test: 'pilot[TestGateway] (1.182985995s)' === 2025-08-04T20:00:10.737341Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:00:10.737364Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:00:10.737358Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:00:11.103701Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/3709d14f13d-7810-4527-a9a8-65e1fc78b486 2025-08-04T20:00:11.103934Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3663s 2025-08-04T20:00:11.104877Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:11.243474Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/370de41062a-544e-486a-8f69-a17610c2dc0c 2025-08-04T20:00:11.243571Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5060s 2025-08-04T20:00:11.244197Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:11.382914Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/3709a163342-7a65-40ee-bce3-c511454b6414 2025-08-04T20:00:11.383165Z info tf istioctl ([x internal-debug --all configz]): completed after 0.6456s 2025-08-04T20:00:11.383696Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway (2.16s) FAIL tests/integration/pilot.TestGateway (re-run 1) (2.16s) 2025-08-04T20:00:11.717814Z info tf === FAILED: Test Run: 'pilot' (exitCode: 1) === 2025-08-04T20:00:11.717927Z info tf === Suite "pilot" run time: 14.474297645s === 2025-08-04T20:00:11.717958Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T20:00:11.720648Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:00:11.720654Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:00:11.720666Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:00:11.995154Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/37075848b05-5f37-4d87-8137-f0867aee1227 2025-08-04T20:00:11.995356Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2745s 2025-08-04T20:00:11.996204Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:12.150012Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/370c0908e4a-6f87-4f39-b59d-67896329f782 2025-08-04T20:00:12.150126Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4292s 2025-08-04T20:00:12.150949Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:12.295414Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/37063d871df-0e10-4812-92ff-387ce96d6be5 2025-08-04T20:00:12.295547Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5746s 2025-08-04T20:00:12.296151Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:12.724054Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:00:12.724173Z info tf === SUCCEEDED: Cleanup Istio in 103.615µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^tagged/gateway-connectivity-tagged-badtag$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 844736 2025-08-04T20:00:29.910391Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:00:29.910483Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:00:29.952485Z info tf === Test Framework Settings === 2025-08-04T20:00:29.952621Z info tf TestID: pilot RunID: a0f13c16-0199-4200-804d-26ca1a94665f NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:00:29.952628Z info tf =============================== 2025-08-04T20:00:29.953328Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a0f13c1601994200804d26ca1 2025-08-04T20:00:29.953448Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:00:29.953469Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:00:29.953492Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:00:29.953505Z info tf === BEGIN: Building clusters === 2025-08-04T20:00:29.958868Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:00:29.958878Z info tf === DONE: Building clusters === 2025-08-04T20:00:29.958910Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:00:29.958939Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:00:29.958947Z info tf === Istio Component Config === 2025-08-04T20:00:29.958996Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:00:29.959006Z info tf ================================ 2025-08-04T20:00:29.964187Z info tf skipping deployment as specified in the config 2025-08-04T20:00:29.964258Z info tf === SUCCEEDED: Deploy Istio in 5.31262ms [Suite=pilot]=== 2025-08-04T20:00:29.964336Z info tf === BEGIN: Create namespace external === 2025-08-04T20:00:29.964338Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:00:29.998938Z info tf === SUCCEEDED: Create namespace external in 34.596514ms === 2025-08-04T20:00:30.000235Z info tf === SUCCEEDED: Create namespace echo in 35.909657ms === 2025-08-04T20:00:30.087171Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:00:30.109966Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:00:30.110018Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a0f13c1601994200804d26ca1/_suite_context/Service.2487223276.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:00:30.110064Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:00:30.110078Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:00:30.110132Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:00:30.130720Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a0f13c1601994200804d26ca1/_suite_context/Service.2487223276.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:00:30.130813Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a0f13c1601994200804d26ca1/_suite_context/Service.2487223276.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-08-04T20:00:30.130822Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-a0f13c1601994200804d26ca1/_suite_context/Service.2487223276.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:00:30.130855Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:00:30.130880Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:00:30.130865Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:00:30.156177Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:00:30.156279Z info tf === SUCCEEDED: Cleanup Istio in 95.548µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^tagged$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 846449 2025-08-04T20:00:42.413025Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:00:42.413069Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:00:42.444252Z info tf === Test Framework Settings === 2025-08-04T20:00:42.444355Z info tf TestID: pilot RunID: 9d501bad-9ca5-4b00-875e-a6849c4b97db NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:00:42.444360Z info tf =============================== 2025-08-04T20:00:42.444482Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-9d501bad9ca54b00875ea6849 2025-08-04T20:00:42.444562Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:00:42.444575Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:00:42.444594Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:00:42.444605Z info tf === BEGIN: Building clusters === 2025-08-04T20:00:42.448908Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:00:42.448917Z info tf === DONE: Building clusters === 2025-08-04T20:00:42.448936Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:00:42.448957Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:00:42.448963Z info tf === Istio Component Config === 2025-08-04T20:00:42.448992Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:00:42.448998Z info tf ================================ 2025-08-04T20:00:42.451370Z info tf skipping deployment as specified in the config 2025-08-04T20:00:42.451385Z info tf === SUCCEEDED: Deploy Istio in 2.424154ms [Suite=pilot]=== 2025-08-04T20:00:42.452933Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:00:42.452921Z info tf === BEGIN: Create namespace external === 2025-08-04T20:00:42.491027Z info tf === SUCCEEDED: Create namespace echo in 38.399987ms === 2025-08-04T20:00:42.500181Z info tf === SUCCEEDED: Create namespace external in 47.51189ms === 2025-08-04T20:00:42.669170Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:00:43.351032Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.351448Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.392309Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.421380Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.424718Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.426108Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.447914Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.452128Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.452128Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.465127Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.468511Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:00:43.493182Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.521764Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.525328Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.526625Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.549035Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.565981Z info klog Caches are synced controller=echo 2025-08-04T20:00:43.569506Z info klog Caches are synced controller=echo 2025-08-04T20:00:54.674868Z info tf === SUCCEEDED: Deploy echo instances in 12.005689616s === 2025-08-04T20:00:54.710981Z info tf === DONE: Setup: 'pilot' (12.262034802s) === 2025-08-04T20:00:54.711031Z info tf === BEGIN: Test Run: 'pilot' === === RUN TestGateway/tagged 2025-08-04T20:00:54.711733Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged]' === 2025-08-04T20:00:54.730343Z info tf istioctl ([tag set tag --revision default]): completed after 0.0185s 2025-08-04T20:00:54.730370Z info tf istioctl error: Error: revision tag "tag" already exists, and --overwrite is false kube.go:122: Unwanted exception for 'istioctl tag set tag --revision default': revision tag "tag" already exists, and --overwrite is false kube.go:123: Output: kube.go:124: Error: Error: revision tag "tag" already exists, and --overwrite is false 2025-08-04T20:00:54.730477Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged] (18.739785ms)' === 2025-08-04T20:00:54.730527Z error tf === Dumping Namespace echo State for TestGateway/tagged... 2025-08-04T20:00:54.730535Z error tf === Dumping Istio Deployment State for TestGateway/tagged... 2025-08-04T20:00:54.730565Z error tf === Dumping Namespace external State for TestGateway/tagged... 2025-08-04T20:00:55.053977Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/38933846b81-dc52-45fa-8f9c-997c7f7d49e5 2025-08-04T20:00:55.054201Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3233s 2025-08-04T20:00:55.054870Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:55.220041Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/3899c355b3d-df8b-4076-9566-ad5d3b7c7406 2025-08-04T20:00:55.220179Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4893s 2025-08-04T20:00:55.221026Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:55.423404Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/38910a43e8f-0c70-48a3-a986-581d9a19e0b9 2025-08-04T20:00:55.423638Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6927s 2025-08-04T20:00:55.424426Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:55.785790Z warn tf cluster/pod cluster-0/echo/b-v1-5bccd7df8d-5dpvr found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T20:00:55.848069Z warn tf cluster/pod cluster-0/echo/sotw-v1-c494d6b8d-5x4f4 found warming resources (dynamic_warming_clusters) on attempt 1 --- FAIL: TestGateway/tagged (2.71s) FAIL tests/integration/pilot.TestGateway/tagged (re-run 1) (2.71s) === RUN TestGateway 2025-08-04T20:00:54.711462Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:00:57.421411Z info tf === DONE (failed): Test: 'pilot[TestGateway] (2.709942773s)' === 2025-08-04T20:00:57.421500Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:00:57.421516Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:00:57.421513Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:00:57.780360Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/3896aa6d253-8268-49cd-b315-cb95975605c9 2025-08-04T20:00:57.780618Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3589s 2025-08-04T20:00:57.781196Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:57.987552Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/3892144b562-0b9e-46f3-a57b-40771a5a802d 2025-08-04T20:00:57.987729Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5659s 2025-08-04T20:00:57.988514Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:58.187060Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/389fce9c7b0-3f06-4b31-9ee1-0fd900495c9c 2025-08-04T20:00:58.187248Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.7654s 2025-08-04T20:00:58.187945Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway (3.85s) FAIL tests/integration/pilot.TestGateway (re-run 1) (3.85s) 2025-08-04T20:00:58.562159Z info tf === FAILED: Test Run: 'pilot' (exitCode: 1) === 2025-08-04T20:00:58.562241Z info tf === Suite "pilot" run time: 16.113305199s === 2025-08-04T20:00:58.562260Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T20:00:58.562556Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:00:58.562568Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:00:58.562556Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:00:58.821128Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/389a1748b22-0525-44e0-8ecf-91ae629f25c8 2025-08-04T20:00:58.821400Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2586s 2025-08-04T20:00:58.821930Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:58.958503Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/389c6a7f157-969e-4d40-ba15-4148eea9dc0c 2025-08-04T20:00:58.958652Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3959s 2025-08-04T20:00:58.959278Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:59.089778Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/389b8b7ab1e-2aa2-4d60-84db-5b343fb8f0a6 2025-08-04T20:00:59.089925Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5271s 2025-08-04T20:00:59.090564Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:59.747522Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:00:59.747649Z info tf === SUCCEEDED: Cleanup Istio in 117.497µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^managed-owner$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 847714 2025-08-04T20:01:11.996743Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:01:11.996820Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:01:12.032404Z info tf === Test Framework Settings === 2025-08-04T20:01:12.032490Z info tf TestID: pilot RunID: 0baf0c22-62bb-4bc2-9869-c16025726c5e NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:01:12.032495Z info tf =============================== 2025-08-04T20:01:12.032729Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-0baf0c2262bb4bc29869c1602 2025-08-04T20:01:12.032796Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:01:12.032805Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:01:12.032820Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:01:12.032826Z info tf === BEGIN: Building clusters === 2025-08-04T20:01:12.038584Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:01:12.038657Z info tf === DONE: Building clusters === 2025-08-04T20:01:12.038675Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:01:12.038707Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:01:12.038716Z info tf === Istio Component Config === 2025-08-04T20:01:12.038751Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:01:12.038755Z info tf ================================ 2025-08-04T20:01:12.040980Z info tf skipping deployment as specified in the config 2025-08-04T20:01:12.040995Z info tf === SUCCEEDED: Deploy Istio in 2.28474ms [Suite=pilot]=== 2025-08-04T20:01:12.041047Z info tf === BEGIN: Create namespace external === 2025-08-04T20:01:12.041068Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:01:12.063334Z info tf === SUCCEEDED: Create namespace external in 22.29348ms === 2025-08-04T20:01:12.065795Z info tf === SUCCEEDED: Create namespace echo in 24.73998ms === 2025-08-04T20:01:12.143663Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:01:12.173399Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:01:12.173462Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-0baf0c2262bb4bc29869c1602/_suite_context/Service.4275879147.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:01:12.173528Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:01:12.173534Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:01:12.173564Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:01:12.383569Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:12.416221Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:12.416671Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:12.480220Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:12.480601Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:12.485460Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:12.495880Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:12.518405Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:12.521067Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:12.527810Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:12.532951Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:12.570006Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:12.587388Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:08Z/39438e3256a-bd19-46dd-af94-287fbe0dfe7c 2025-08-04T20:01:12.587529Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4137s 2025-08-04T20:01:12.588129Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:01:12.641416Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:12.657938Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:12.704250Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:12.750974Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:12.767675Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:12.798955Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:12.822005Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:12.831084Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:12.851380Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:12.872618Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:12.889768Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:12.897224Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:12.905191Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:12.905495Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:12.919262Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:12.989231Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:12.989657Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:08Z/394ef54a816-b5ac-4571-b83b-80917850b2fb 2025-08-04T20:01:12.989741Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.8159s 2025-08-04T20:01:12.990321Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:01:13.008060Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:13.012788Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.014451Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.026131Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.032578Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.048610Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.077899Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:13.094421Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.094592Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:13.099100Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.102009Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.154061Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:13.154087Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.154090Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.154104Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.166059Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.181264Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.193634Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:13.209178Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:13.220862Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.231327Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.231761Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:13.250789Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:13Z/395743d0cda-49cb-4432-9329-d274e3ae166f 2025-08-04T20:01:13.250885Z info tf istioctl ([x internal-debug --all mcsz]): completed after 1.0770s 2025-08-04T20:01:13.251504Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:01:13.267843Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.271608Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:13.272194Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.302627Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.303580Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.305813Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.309080Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.316118Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:13.318081Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.327227Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:13.328592Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: port forward: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo")) 2025-08-04T20:01:13.338027Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: port forward: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo")) 2025-08-04T20:01:13.341626Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-0baf0c2262bb4bc29869c1602/_suite_context/Service.4275879147.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:01:13.341651Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-0baf0c2262bb4bc29869c1602/_suite_context/Service.4275879147.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-08-04T20:01:13.341660Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-0baf0c2262bb4bc29869c1602/_suite_context/Service.4275879147.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:01:13.341692Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:01:13.341699Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:01:13.341733Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:01:13.539916Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.583951Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.611948Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.621295Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:13.642041Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.655454Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-8flnw_echo") 2025-08-04T20:01:13.658389Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:13.662374Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.669352Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.675707Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-5x4f4_echo") 2025-08-04T20:01:13.740858Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.753995Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:13.862230Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.872588Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:13Z/396d0e19727-7d47-4b56-a4a2-8ceedf4e9fe0 2025-08-04T20:01:13.872679Z info tf istioctl ([x internal-debug --all configz]): completed after 0.5308s 2025-08-04T20:01:13.873298Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:01:13.922947Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:13.926947Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.986326Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:13.990899Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:13.997947Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:14.026579Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:14.030579Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-5dpvr_echo") 2025-08-04T20:01:14.118094Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:14.129011Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:14.143751Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("statefulset-v1-0_echo") 2025-08-04T20:01:14.181697Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:14.184639Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-j5bpx_echo") 2025-08-04T20:01:14.186472Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:13Z/396a9934554-d6fc-4ac2-bc4b-80ec02135515 2025-08-04T20:01:14.186539Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.8446s 2025-08-04T20:01:14.187289Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:01:14.249924Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-wp7ht_echo") 2025-08-04T20:01:14.250381Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:01:14.278019Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:01:14.314009Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:01:14.314064Z info tf === SUCCEEDED: Cleanup Istio in 51.652µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^status$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 849104 2025-08-04T20:01:26.419629Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:01:26.419672Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:01:26.451960Z info tf === Test Framework Settings === 2025-08-04T20:01:26.452029Z info tf TestID: pilot RunID: 6ffc921b-32c6-4eb9-99a3-b5860e751ae1 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:01:26.452035Z info tf =============================== 2025-08-04T20:01:26.452172Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-6ffc921b32c64eb999a3b5860 2025-08-04T20:01:26.452249Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:01:26.452260Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:01:26.452275Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:01:26.452282Z info tf === BEGIN: Building clusters === 2025-08-04T20:01:26.455884Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:01:26.455893Z info tf === DONE: Building clusters === 2025-08-04T20:01:26.455906Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:01:26.455924Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:01:26.455929Z info tf === Istio Component Config === 2025-08-04T20:01:26.455954Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:01:26.455958Z info tf ================================ 2025-08-04T20:01:26.457927Z info tf skipping deployment as specified in the config 2025-08-04T20:01:26.457939Z info tf === SUCCEEDED: Deploy Istio in 2.012652ms [Suite=pilot]=== 2025-08-04T20:01:26.457992Z info tf === BEGIN: Create namespace external === 2025-08-04T20:01:26.458016Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:01:26.488873Z info tf === SUCCEEDED: Create namespace external in 30.877972ms === 2025-08-04T20:01:26.505364Z info tf === SUCCEEDED: Create namespace echo in 47.346719ms === 2025-08-04T20:01:26.717568Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:01:27.586400Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.633559Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.645770Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.648920Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.682017Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.686755Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.689393Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.694016Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.695743Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.704370Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:01:27.734349Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.745922Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.749600Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.783104Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.790235Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.794878Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.796248Z info klog Caches are synced controller=echo 2025-08-04T20:01:27.804500Z info klog Caches are synced controller=echo 2025-08-04T20:01:38.901326Z info tf === SUCCEEDED: Deploy echo instances in 12.183742197s === 2025-08-04T20:01:38.932273Z info tf === DONE: Setup: 'pilot' (12.476357621s) === 2025-08-04T20:01:38.932298Z info tf === BEGIN: Test Run: 'pilot' === === RUN TestGateway/status 2025-08-04T20:01:38.932951Z info tf === BEGIN: Test: 'pilot[TestGateway/status]' === gateway_test.go:741: retry.UntilSuccessOrFail: timeout while waiting after 188 attempts (last error: failed to find accepted condition: {Type: Status: ObservedGeneration:0 LastTransitionTime:0001-01-01 00:00:00 +0000 UTC Reason: Message:}) 2025-08-04T20:02:08.933561Z info tf === DONE (failed): Test: 'pilot[TestGateway/status] (30.000603546s)' === 2025-08-04T20:02:08.933694Z error tf === Dumping Namespace echo State for TestGateway/status... 2025-08-04T20:02:08.933728Z error tf === Dumping Istio Deployment State for TestGateway/status... 2025-08-04T20:02:08.933720Z error tf === Dumping Namespace external State for TestGateway/status... 2025-08-04T20:02:09.322292Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/4055f373d8f-c1d2-4884-ba8f-045e2265e6c5 2025-08-04T20:02:09.322459Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3883s 2025-08-04T20:02:09.323147Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:09.467286Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/4057cd6c6f2-df79-4414-a109-1373c2456a9e 2025-08-04T20:02:09.467422Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5332s 2025-08-04T20:02:09.468143Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:09.615905Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/405fe7dc5cd-a773-43f1-a677-e02fce0d084a 2025-08-04T20:02:09.616045Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6818s 2025-08-04T20:02:09.616572Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway/status (31.29s) FAIL tests/integration/pilot.TestGateway/status (re-run 1) (31.29s) === RUN TestGateway 2025-08-04T20:01:38.932671Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:02:10.225045Z info tf === DONE (failed): Test: 'pilot[TestGateway] (31.292362837s)' === 2025-08-04T20:02:10.225195Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:02:10.225203Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:02:10.225205Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:02:10.483318Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/4055ad26b64-1f85-4e9b-9c2f-dae701c8f445 2025-08-04T20:02:10.483465Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2580s 2025-08-04T20:02:10.484243Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:10.632772Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/405906328bb-2801-4396-b36d-d796b510c4a6 2025-08-04T20:02:10.632961Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4075s 2025-08-04T20:02:10.633692Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:10.834623Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/405e5a976d6-e660-492d-b73a-b7ee0c5c70ea 2025-08-04T20:02:10.834778Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6093s 2025-08-04T20:02:10.835520Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway (32.33s) FAIL tests/integration/pilot.TestGateway (re-run 1) (32.33s) 2025-08-04T20:02:11.260997Z info tf === FAILED: Test Run: 'pilot' (exitCode: 1) === 2025-08-04T20:02:11.261105Z info tf === Suite "pilot" run time: 44.805191236s === 2025-08-04T20:02:11.261130Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T20:02:11.261413Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:02:11.261415Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:02:11.261426Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:02:11.547001Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/405abe3107b-1c41-4bc9-9806-3e649560329a 2025-08-04T20:02:11.547177Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2855s 2025-08-04T20:02:11.548130Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:11.700883Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/40597455eec-5bf5-486d-aa1d-81e97c6e08cb 2025-08-04T20:02:11.701073Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4394s 2025-08-04T20:02:11.701784Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:11.828449Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/40531c239dc-eb6d-4990-b1f1-2fec15517a29 2025-08-04T20:02:11.828590Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5669s 2025-08-04T20:02:11.829464Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:12.237641Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:02:12.237752Z info tf === SUCCEEDED: Cleanup Istio in 100.875µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^managed-short-name$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 850653 2025-08-04T20:02:24.679518Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:02:24.679595Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:02:24.711713Z info tf === Test Framework Settings === 2025-08-04T20:02:24.711790Z info tf TestID: pilot RunID: 86476674-a09c-4895-8106-ae69e82f1349 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:02:24.711798Z info tf =============================== 2025-08-04T20:02:24.711965Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-86476674a09c48958106ae69e 2025-08-04T20:02:24.712040Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:02:24.712049Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:02:24.712067Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:02:24.712073Z info tf === BEGIN: Building clusters === 2025-08-04T20:02:24.717974Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:02:24.718025Z info tf === DONE: Building clusters === 2025-08-04T20:02:24.718043Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:02:24.718071Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:02:24.718077Z info tf === Istio Component Config === 2025-08-04T20:02:24.718109Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:02:24.718115Z info tf ================================ 2025-08-04T20:02:24.720251Z info tf skipping deployment as specified in the config 2025-08-04T20:02:24.720265Z info tf === SUCCEEDED: Deploy Istio in 2.190971ms [Suite=pilot]=== 2025-08-04T20:02:24.720344Z info tf === BEGIN: Create namespace external === 2025-08-04T20:02:24.720359Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:02:24.737741Z info tf === SUCCEEDED: Create namespace echo in 17.387501ms === 2025-08-04T20:02:24.746297Z info tf === SUCCEEDED: Create namespace external in 25.964092ms === 2025-08-04T20:02:24.843868Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:02:25.180258Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.182356Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.191191Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.203315Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.208133Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.210312Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.226382Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.267899Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:25.280574Z info klog Caches are synced controller=echo 2025-08-04T20:02:25.284814Z info klog Caches are synced controller=echo 2025-08-04T20:02:25.296967Z info klog Caches are synced controller=echo 2025-08-04T20:02:25.305174Z info klog Caches are synced controller=echo 2025-08-04T20:02:25.308536Z info klog Caches are synced controller=echo 2025-08-04T20:02:25.311012Z info klog Caches are synced controller=echo 2025-08-04T20:02:25.327187Z info klog Caches are synced controller=echo 2025-08-04T20:02:25.368092Z info klog Caches are synced controller=echo 2025-08-04T20:02:29.877934Z info tf echo pod echo/proxyless-grpc-v1-759745c5b9-ctdvm (in cluster cluster-0) transitioned to NOT READY. Pod Status=Succeeded 2025-08-04T20:02:30.030944Z info tf echo pod echo/naked-v1-5bf694c455-f5946 (in cluster cluster-0) transitioned to NOT READY. Pod Status=Succeeded 2025-08-04T20:02:30.071757Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:02:30.071838Z error tf 1 error occurred: * failed deploying echo statefulset.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-86476674a09c48958106ae69e/_suite_context/StatefulSet.3444797314.yaml] to ns echo in cluster cluster-0: apply: patch: statefulsets.apps "statefulset-v1" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:02:30.071906Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:02:30.071910Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:02:30.071918Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:02:30.616438Z error klog an error occurred forwarding 43677 -> 15020: error forwarding port 15020 to pod 8121f780baf27b248685cd77139c2e7eec0c897f31521e4769360f0fc564fa27, uid : port forward into network namespace "/var/run/netns/1a2c6d45-08f1-483d-a86d-5b0530d9f018": failed to connect to localhost:15020 inside namespace 8121f780baf27b248685cd77139c2e7eec0c897f31521e4769360f0fc564fa27: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:02:30.618087Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-ktcp4 for: Get "http://localhost:43677/debug/ndsz": EOF 2025-08-04T20:02:30.618089Z error port forward failed: lost connection to pod 2025-08-04T20:02:30.620125Z error klog an error occurred forwarding 38691 -> 15020: error forwarding port 15020 to pod c418b2e411cd3c19b5d7e5d3c95e89ef1b38e20b2dac38ce685342d923e5e193, uid : port forward into network namespace "/var/run/netns/7e5deece-729e-4e59-9693-6c940a390738": failed to connect to localhost:15020 inside namespace c418b2e411cd3c19b5d7e5d3c95e89ef1b38e20b2dac38ce685342d923e5e193: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:02:30.621459Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-ktcp4 for: Get "http://localhost:43677/stats/prometheus": dial tcp 127.0.0.1:43677: connect: connection refused 2025-08-04T20:02:30.621590Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-s5ws8 for: Get "http://localhost:38691/debug/ndsz": EOF 2025-08-04T20:02:30.621628Z error port forward failed: lost connection to pod 2025-08-04T20:02:30.622265Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/c-v1-5f56c57bb9-s5ws8 for: Get "http://localhost:38691/stats/prometheus": dial tcp 127.0.0.1:38691: connect: connection refused 2025-08-04T20:02:30.752265Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:02:30Z/4176ffc5a06-c4f1-4396-a251-06564849984d 2025-08-04T20:02:30.752396Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.6801s 2025-08-04T20:02:30.753097Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:30.887241Z error klog an error occurred forwarding 37253 -> 15020: error forwarding port 15020 to pod a3eb0a84c9a4ac1e315aaa7c6909500c8e631b47934af57b3291ff11b46f03d4, uid : port forward into network namespace "/var/run/netns/2e3a5d93-848d-4160-83a5-059663c97f99": failed to connect to localhost:15020 inside namespace a3eb0a84c9a4ac1e315aaa7c6909500c8e631b47934af57b3291ff11b46f03d4: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:02:30.888809Z error klog an error occurred forwarding 35527 -> 15020: error forwarding port 15020 to pod 9a4f7ba93cc6b8e72abcb1957efc236e3872245a49a368b43de75eac0ea2eee5, uid : port forward into network namespace "/var/run/netns/fa29af64-2a3b-4b2e-9e8f-a1fea9237ac2": failed to connect to localhost:15020 inside namespace 9a4f7ba93cc6b8e72abcb1957efc236e3872245a49a368b43de75eac0ea2eee5: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:02:30.889093Z error port forward failed: lost connection to pod 2025-08-04T20:02:30.889116Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-d5n5n for: Get "http://localhost:37253/debug/ndsz": EOF 2025-08-04T20:02:30.890033Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-d5n5n for: Get "http://localhost:37253/stats/prometheus": dial tcp 127.0.0.1:37253: connect: connection refused 2025-08-04T20:02:30.890359Z error port forward failed: lost connection to pod 2025-08-04T20:02:30.890384Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-fg9m8 for: Get "http://localhost:35527/debug/ndsz": EOF 2025-08-04T20:02:30.891127Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-fg9m8 for: Get "http://localhost:35527/stats/prometheus": dial tcp 127.0.0.1:35527: connect: connection refused 2025-08-04T20:02:30.910036Z error klog an error occurred forwarding 44381 -> 15020: error forwarding port 15020 to pod ef22fac6a9f714bef9999141dfb0d32f504ac40e498cbb77ef9e911fbc15ed28, uid : port forward into network namespace "/var/run/netns/e3f51568-aff9-4cfd-a15e-db9e18a92238": failed to connect to localhost:15020 inside namespace ef22fac6a9f714bef9999141dfb0d32f504ac40e498cbb77ef9e911fbc15ed28: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:02:30.911774Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-pcl8p for: Get "http://localhost:44381/debug/ndsz": EOF 2025-08-04T20:02:30.911866Z error port forward failed: lost connection to pod 2025-08-04T20:02:30.912628Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-pcl8p for: Get "http://localhost:44381/stats/prometheus": dial tcp 127.0.0.1:44381: connect: connection refused 2025-08-04T20:02:30.912654Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:02:31.317849Z warn tf cluster/pod cluster-0/echo/sotw-v1-c494d6b8d-fg9m8 found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T20:02:31.478162Z warn tf cluster/pod cluster-0/echo/headless-v1-5455bcc7b9-pcl8p found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T20:02:32.067530Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:02:30Z/4171fb6a660-e6d3-4e65-88e8-d94510f373fc 2025-08-04T20:02:32.067695Z info tf istioctl ([x internal-debug --all configz]): completed after 1.9954s 2025-08-04T20:02:32.068347Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:32.137753Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/naked-v1-5bf694c455-f5946/app for: pods "naked-v1-5bf694c455-f5946" not found 2025-08-04T20:02:32.144686Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/proxyless-grpc-v1-759745c5b9-ctdvm/istio-proxy for: pods "proxyless-grpc-v1-759745c5b9-ctdvm" not found 2025-08-04T20:02:32.148170Z warn tf Unable to get logs for cluster/pod/container: cluster-0/echo/proxyless-grpc-v1-759745c5b9-ctdvm/app for: pods "proxyless-grpc-v1-759745c5b9-ctdvm" not found 2025-08-04T20:02:32.254540Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:02:30Z/417576e8e4b-13c8-44e3-a83c-f8ea02afbee6 2025-08-04T20:02:32.254640Z info tf istioctl ([x internal-debug --all clusterz]): completed after 2.1823s 2025-08-04T20:02:32.255433Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:32.471446Z error tf Unable to get execute command "config_dump?include_eds=true" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-d5n5n for: Get "http://localhost:33521/config_dump?include_eds=true": EOF 2025-08-04T20:02:32.483405Z error klog an error occurred forwarding 33521 -> 15000: error forwarding port 15000 to pod a3eb0a84c9a4ac1e315aaa7c6909500c8e631b47934af57b3291ff11b46f03d4, uid : port forward into network namespace "/var/run/netns/2e3a5d93-848d-4160-83a5-059663c97f99": failed to connect to localhost:15000 inside namespace a3eb0a84c9a4ac1e315aaa7c6909500c8e631b47934af57b3291ff11b46f03d4: dial tcp [::1]:15000: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:02:32.485321Z error port forward failed: lost connection to pod 2025-08-04T20:02:32.485414Z error tf Unable to get execute command "clusters" on cluster/pod: cluster-0/echo/a-v1-6b586f9d47-d5n5n for: Get "http://localhost:33521/clusters": EOF 2025-08-04T20:02:32.566285Z error klog an error occurred forwarding 35093 -> 15000: error forwarding port 15000 to pod 8121f780baf27b248685cd77139c2e7eec0c897f31521e4769360f0fc564fa27, uid : sandbox 8121f780baf27b248685cd77139c2e7eec0c897f31521e4769360f0fc564fa27 is not running: Unhandled Error logger=UnhandledError 2025-08-04T20:02:32.567828Z error tf Unable to get execute command "clusters" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-ktcp4 for: Get "http://localhost:35093/clusters": EOF 2025-08-04T20:02:32.567827Z error port forward failed: lost connection to pod 2025-08-04T20:02:32.589697Z error klog an error occurred forwarding 34981 -> 15000: error forwarding port 15000 to pod ef22fac6a9f714bef9999141dfb0d32f504ac40e498cbb77ef9e911fbc15ed28, uid : port forward into network namespace "/var/run/netns/e3f51568-aff9-4cfd-a15e-db9e18a92238": failed to connect to localhost:15000 inside namespace ef22fac6a9f714bef9999141dfb0d32f504ac40e498cbb77ef9e911fbc15ed28: dial tcp [::1]:15000: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:02:32.591681Z error tf FAIL: Unable to get execute command "config_dump?include_eds=true" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-pcl8p for: Get "http://localhost:34981/config_dump?include_eds=true": EOF 2025-08-04T20:02:32.591689Z error port forward failed: lost connection to pod 2025-08-04T20:02:32.592528Z error tf Unable to get execute command "clusters" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-pcl8p for: Get "http://localhost:34981/clusters": dial tcp 127.0.0.1:34981: connect: connection refused 2025-08-04T20:02:33.170712Z error klog an error occurred forwarding 44711 -> 15000: error forwarding port 15000 to pod 9a4f7ba93cc6b8e72abcb1957efc236e3872245a49a368b43de75eac0ea2eee5, uid : sandbox 9a4f7ba93cc6b8e72abcb1957efc236e3872245a49a368b43de75eac0ea2eee5 is not running: Unhandled Error logger=UnhandledError 2025-08-04T20:02:33.172692Z error tf FAIL: Unable to get execute command "config_dump?include_eds=true" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-fg9m8 for: Get "http://localhost:44711/config_dump?include_eds=true": EOF 2025-08-04T20:02:33.172741Z error port forward failed: lost connection to pod 2025-08-04T20:02:33.173485Z error tf Unable to get execute command "clusters" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-fg9m8 for: Get "http://localhost:44711/clusters": dial tcp 127.0.0.1:44711: connect: connection refused 2025-08-04T20:02:33.179345Z error tf Test setup error: 1 error occurred: * failed deploying echo statefulset.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-86476674a09c48958106ae69e/_suite_context/StatefulSet.3444797314.yaml] to ns echo in cluster cluster-0: apply: patch: statefulsets.apps "statefulset-v1" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:02:33.179366Z info tf === FAILED: Setup: 'pilot' (1 error occurred: * failed deploying echo statefulset.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-86476674a09c48958106ae69e/_suite_context/StatefulSet.3444797314.yaml] to ns echo in cluster cluster-0: apply: patch: statefulsets.apps "statefulset-v1" is forbidden: unable to create new content in namespace echo because it is being terminated ) === 2025-08-04T20:02:33.179373Z error tf Exiting due to setup failure: 1 error occurred: * failed deploying echo statefulset.echo.svc.cluster.local to cluster cluster-0: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-86476674a09c48958106ae69e/_suite_context/StatefulSet.3444797314.yaml] to ns echo in cluster cluster-0: apply: patch: statefulsets.apps "statefulset-v1" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:02:33.179400Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:02:33.179406Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:02:33.179438Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:02:33.394363Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:33.411939Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:33.412333Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:33.441667Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:33.441668Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:33.441724Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:33.450762Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:33.453272Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:33.454351Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:33.481511Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:33.517352Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:02:30Z/417f50e0fc6-6356-493f-b636-a622bbed356c 2025-08-04T20:02:33.517478Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3378s 2025-08-04T20:02:33.518228Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:33.554309Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:33.583807Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:33.586155Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:33.598029Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:33.607883Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:33.619896Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:33.621489Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:33.626090Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:33.635318Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:33.636331Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:33.733019Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:33.784818Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:33.802460Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:33.802715Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:33.803647Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:33.803954Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:33.804223Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:33.821543Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:33.884475Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:33.884475Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:33.918954Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:02:30Z/41748566e46-d717-4bd8-a95a-323c2e77c89d 2025-08-04T20:02:33.919086Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.7393s 2025-08-04T20:02:33.919666Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:33.967586Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:33.980086Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:33.999144Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:34.000125Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:34.011867Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:34.041716Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:34.049306Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:34.049771Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:34.073054Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:34.089904Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:34.090346Z info tf echo pod echo/b-v1-5bccd7df8d-ktcp4 (in cluster cluster-0) transitioned to NOT READY. Pod Status=Succeeded 2025-08-04T20:02:34.111962Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:34.142089Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:34.142089Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:34.142174Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-fg9m8_echo") 2025-08-04T20:02:34.145649Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo") 2025-08-04T20:02:34.156915Z info tf echo pod echo/c-v1-5f56c57bb9-s5ws8 (in cluster cluster-0) transitioned to NOT READY. Pod Status=Succeeded 2025-08-04T20:02:34.167212Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:34.172914Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:34.175614Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo") 2025-08-04T20:02:34.175997Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:02:30Z/417ab334dbb-84c6-484e-9830-c0a3422f3b46 2025-08-04T20:02:34.176110Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.9963s 2025-08-04T20:02:34.177001Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:34.186300Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-pcl8p_echo") 2025-08-04T20:02:34.186425Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: port forward: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-d5n5n_echo")) 2025-08-04T20:02:34.194951Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-s5ws8_echo") 2025-08-04T20:02:34.205756Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: port forward: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-ktcp4_echo")) 2025-08-04T20:02:34.229312Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:02:34.229391Z info tf === SUCCEEDED: Cleanup Istio in 72.913µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestProxyProtocolTCPGateway$/^filter/a$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 852043 2025-08-04T20:02:46.144152Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:02:46.144201Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:02:46.181091Z info tf === Test Framework Settings === 2025-08-04T20:02:46.181180Z info tf TestID: pilot RunID: 29c20ca0-e684-4433-80b0-3fe8db15abcf NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:02:46.181189Z info tf =============================== 2025-08-04T20:02:46.181422Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-29c20ca0e684443380b03fe8d 2025-08-04T20:02:46.181501Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:02:46.181510Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:02:46.181528Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:02:46.181535Z info tf === BEGIN: Building clusters === 2025-08-04T20:02:46.187799Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:02:46.187861Z info tf === DONE: Building clusters === 2025-08-04T20:02:46.187882Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:02:46.187912Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:02:46.187918Z info tf === Istio Component Config === 2025-08-04T20:02:46.187984Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:02:46.187995Z info tf ================================ 2025-08-04T20:02:46.190367Z info tf skipping deployment as specified in the config 2025-08-04T20:02:46.190382Z info tf === SUCCEEDED: Deploy Istio in 2.466477ms [Suite=pilot]=== 2025-08-04T20:02:46.190435Z info tf === BEGIN: Create namespace external === 2025-08-04T20:02:46.190453Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:02:46.213212Z info tf === SUCCEEDED: Create namespace echo in 22.751732ms === 2025-08-04T20:02:46.214213Z info tf === SUCCEEDED: Create namespace external in 23.788114ms === 2025-08-04T20:02:46.330773Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:02:47.035648Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.059509Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.064911Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.067140Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.100402Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.102442Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.110590Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.112303Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.114042Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:02:47.136408Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.160056Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.165646Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.168065Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.201439Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.202913Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.211439Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.212762Z info klog Caches are synced controller=echo 2025-08-04T20:02:47.215173Z info klog Caches are synced controller=echo 2025-08-04T20:02:58.319094Z info tf === SUCCEEDED: Deploy echo instances in 11.988321758s === 2025-08-04T20:02:58.368811Z info tf === DONE: Setup: 'pilot' (12.180913678s) === 2025-08-04T20:02:58.368893Z info tf === BEGIN: Test Run: 'pilot' === PASS tests/integration/pilot.TestProxyProtocolTCPGateway/filter/a (re-run 1) (0.27s) PASS tests/integration/pilot.TestProxyProtocolTCPGateway/filter (re-run 1) (0.27s) PASS tests/integration/pilot.TestProxyProtocolTCPGateway (re-run 1) (5.49s) 2025-08-04T20:03:03.862172Z info tf === DONE: Test Run: 'pilot' === 2025-08-04T20:03:03.862197Z info tf === Suite "pilot" run time: 17.674322866s === 2025-08-04T20:03:03.862208Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T20:03:03.892111Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:03:03.892138Z info tf === SUCCEEDED: Cleanup Istio in 23.685µs [Suite=pilot] === PASS tests/integration/pilot exec: [go test -json -test.run=^TestProxyProtocolTCPGateway$/^filter$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 853381 2025-08-04T20:03:18.850008Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:18.850120Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:18.892534Z info tf === Test Framework Settings === 2025-08-04T20:03:18.892730Z info tf TestID: pilot RunID: 3728aafc-448c-4c92-8159-8592a9875adf NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:03:18.892738Z info tf =============================== 2025-08-04T20:03:18.892945Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3728aafc448c4c9281598592a 2025-08-04T20:03:18.893074Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:03:18.893092Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:03:18.893118Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:03:18.893134Z info tf === BEGIN: Building clusters === 2025-08-04T20:03:18.897374Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:03:18.897384Z info tf === DONE: Building clusters === 2025-08-04T20:03:18.897423Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:03:18.897455Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:03:18.897465Z info tf === Istio Component Config === 2025-08-04T20:03:18.897516Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:03:18.897525Z info tf ================================ 2025-08-04T20:03:18.903148Z info tf skipping deployment as specified in the config 2025-08-04T20:03:18.903240Z info tf === SUCCEEDED: Deploy Istio in 5.776256ms [Suite=pilot]=== 2025-08-04T20:03:18.903315Z info tf === BEGIN: Create namespace external === 2025-08-04T20:03:18.903325Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:03:18.925180Z info tf === SUCCEEDED: Create namespace external in 21.867245ms === 2025-08-04T20:03:18.932305Z info tf === SUCCEEDED: Create namespace echo in 28.98125ms === 2025-08-04T20:03:19.023880Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:03:19.048275Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:03:19.048355Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3728aafc448c4c9281598592a/_suite_context/Service.1183943257.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:03:19.048401Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:03:19.048428Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:03:19.048466Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:03:19.226539Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:03:19.230988Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3728aafc448c4c9281598592a/_suite_context/Service.1183943257.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:03:19.231023Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3728aafc448c4c9281598592a/_suite_context/Service.1183943257.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-08-04T20:03:19.231029Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3728aafc448c4c9281598592a/_suite_context/Service.1183943257.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:03:19.231063Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:03:19.231072Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:03:19.231113Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:03:19.365002Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:03:17Z/43677400ed6-ae1e-40ba-bb29-ef51c067b330 2025-08-04T20:03:19.365254Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3166s 2025-08-04T20:03:19.366046Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:03:19.441890Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:03:19.470787Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:03:19.470897Z info tf === SUCCEEDED: Cleanup Istio in 100.478µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestXfccHeaders$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 854335 2025-08-04T20:03:33.394847Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:33.394906Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:33.430412Z info tf === Test Framework Settings === 2025-08-04T20:03:33.430474Z info tf TestID: pilot RunID: 07f110c8-49ee-4004-81cf-f3053aa0111c NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:03:33.430479Z info tf =============================== 2025-08-04T20:03:33.430635Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-07f110c849ee400481cff3053 2025-08-04T20:03:33.430720Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:03:33.430730Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:03:33.430747Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:03:33.430755Z info tf === BEGIN: Building clusters === 2025-08-04T20:03:33.434712Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:03:33.434723Z info tf === DONE: Building clusters === 2025-08-04T20:03:33.434741Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:03:33.434772Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:03:33.434780Z info tf === Istio Component Config === 2025-08-04T20:03:33.434820Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:03:33.434826Z info tf ================================ 2025-08-04T20:03:33.437137Z info tf skipping deployment as specified in the config 2025-08-04T20:03:33.437150Z info tf === SUCCEEDED: Deploy Istio in 2.375352ms [Suite=pilot]=== 2025-08-04T20:03:33.437205Z info tf === BEGIN: Create namespace external === 2025-08-04T20:03:33.437220Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:03:33.454227Z info tf === SUCCEEDED: Create namespace echo in 17.008896ms === 2025-08-04T20:03:33.476229Z info tf === SUCCEEDED: Create namespace external in 39.023307ms === 2025-08-04T20:03:33.563282Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:03:33.627769Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:03:33.627822Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-07f110c849ee400481cff3053/_suite_context/ServiceAccount-Service.3445064815.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:03:33.627862Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:03:33.627888Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:03:33.627889Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:03:33.849968Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:03:33.854400Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-07f110c849ee400481cff3053/_suite_context/ServiceAccount-Service.3445064815.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:03:33.854455Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-07f110c849ee400481cff3053/_suite_context/ServiceAccount-Service.3445064815.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-08-04T20:03:33.854464Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-07f110c849ee400481cff3053/_suite_context/ServiceAccount-Service.3445064815.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "a" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:03:33.854498Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:03:33.854527Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:03:33.854548Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:03:33.926150Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:03:33Z/438a9d88268-7333-43d7-88fe-cb552d29286f 2025-08-04T20:03:33.926260Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2978s 2025-08-04T20:03:33.926943Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:03:34.005836Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:03:34.018498Z warn tf cluster/pod cluster-0/istio-system/istio-ingressgateway-b7b89b8d5-htcb9 found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T20:03:34.027391Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:03:34.027412Z info tf === SUCCEEDED: Cleanup Istio in 17.62µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestTunnelingOutboundTraffic$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 855588 2025-08-04T20:03:46.137525Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:46.137577Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:46.172874Z info tf === Test Framework Settings === 2025-08-04T20:03:46.172970Z info tf TestID: pilot RunID: 61dba913-8cb8-44ac-9f89-664e448888bd NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:03:46.172976Z info tf =============================== 2025-08-04T20:03:46.173120Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-61dba9138cb844ac9f89664e4 2025-08-04T20:03:46.173198Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:03:46.173210Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:03:46.173230Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:03:46.173238Z info tf === BEGIN: Building clusters === 2025-08-04T20:03:46.177310Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:03:46.177322Z info tf === DONE: Building clusters === 2025-08-04T20:03:46.177349Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:03:46.177374Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:03:46.177381Z info tf === Istio Component Config === 2025-08-04T20:03:46.177414Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:03:46.177421Z info tf ================================ 2025-08-04T20:03:46.182173Z info tf skipping deployment as specified in the config 2025-08-04T20:03:46.182251Z info tf === SUCCEEDED: Deploy Istio in 4.869293ms [Suite=pilot]=== 2025-08-04T20:03:46.182333Z info tf === BEGIN: Create namespace external === 2025-08-04T20:03:46.182335Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:03:46.199796Z info tf === SUCCEEDED: Create namespace echo in 17.462037ms === 2025-08-04T20:03:46.210420Z info tf === SUCCEEDED: Create namespace external in 28.092598ms === 2025-08-04T20:03:46.363914Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:03:46.412960Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:03:46.413060Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-61dba9138cb844ac9f89664e4/_suite_context/ServiceAccount-Service.3093630219.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:03:46.413134Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:03:46.413154Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:03:46.413163Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:03:46.466166Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-61dba9138cb844ac9f89664e4/_suite_context/ServiceAccount-Service.3093630219.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:03:46.466273Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-61dba9138cb844ac9f89664e4/_suite_context/ServiceAccount-Service.3093630219.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-08-04T20:03:46.466284Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-61dba9138cb844ac9f89664e4/_suite_context/ServiceAccount-Service.3093630219.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:03:46.466341Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:03:46.466345Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:03:46.466359Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:03:46.570850Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:03:46.570952Z info tf === SUCCEEDED: Cleanup Istio in 96.146µs [Suite=pilot] === FAIL tests/integration/pilot DONE 2 runs, 746 tests, 52 skipped, 28 failures in 1362.945s exec: [go test -json -test.run=^TestGateway$/^unmanaged$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 856899 2025-08-04T20:03:58.696933Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:58.696988Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:03:58.728072Z info tf === Test Framework Settings === 2025-08-04T20:03:58.728141Z info tf TestID: pilot RunID: 3aa8bd7c-1c52-4ac8-bbb7-4155e1414dd5 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:03:58.728146Z info tf =============================== 2025-08-04T20:03:58.728336Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3aa8bd7c1c524ac8bbb74155e 2025-08-04T20:03:58.728421Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:03:58.728431Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:03:58.728451Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:03:58.728458Z info tf === BEGIN: Building clusters === 2025-08-04T20:03:58.735212Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:03:58.735255Z info tf === DONE: Building clusters === 2025-08-04T20:03:58.735280Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:03:58.735314Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:03:58.735322Z info tf === Istio Component Config === 2025-08-04T20:03:58.735367Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:03:58.735377Z info tf ================================ 2025-08-04T20:03:58.738180Z info tf skipping deployment as specified in the config 2025-08-04T20:03:58.738193Z info tf === SUCCEEDED: Deploy Istio in 2.874981ms [Suite=pilot]=== 2025-08-04T20:03:58.738246Z info tf === BEGIN: Create namespace external === 2025-08-04T20:03:58.738273Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:03:58.761599Z info tf === SUCCEEDED: Create namespace external in 23.360774ms === 2025-08-04T20:03:58.768741Z info tf === SUCCEEDED: Create namespace echo in 30.477076ms === 2025-08-04T20:03:58.973672Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:03:59.833969Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.881241Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.883001Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.887105Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.907087Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.929733Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.933468Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.933602Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.934891Z info klog Caches are synced controller=echo 2025-08-04T20:03:59.967547Z info klog Waiting for caches to sync controller=echo 2025-08-04T20:03:59.981701Z info klog Caches are synced controller=echo 2025-08-04T20:03:59.983217Z info klog Caches are synced controller=echo 2025-08-04T20:03:59.987591Z info klog Caches are synced controller=echo 2025-08-04T20:04:00.008048Z info klog Caches are synced controller=echo 2025-08-04T20:04:00.030678Z info klog Caches are synced controller=echo 2025-08-04T20:04:00.034305Z info klog Caches are synced controller=echo 2025-08-04T20:04:00.034313Z info klog Caches are synced controller=echo 2025-08-04T20:04:00.068027Z info klog Caches are synced controller=echo 2025-08-04T20:04:38.385835Z info tf === SUCCEEDED: Deploy echo instances in 39.41216817s === 2025-08-04T20:04:38.418725Z info tf === DONE: Setup: 'pilot' (39.683432393s) === 2025-08-04T20:04:38.418753Z info tf === BEGIN: Test Run: 'pilot' === === RUN TestGateway/unmanaged 2025-08-04T20:04:38.419398Z info tf === BEGIN: Test: 'pilot[TestGateway/unmanaged]' === gateway_test.go:621: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3aa8bd7c1c524ac8bbb74155e/TestGateway/unmanaged/_test_context/HTTPRoute-TCPRoute-GRPCRoute-ReferenceGrant.278508989.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T20:04:38.525010Z info tf === DONE (failed): Test: 'pilot[TestGateway/unmanaged] (105.606448ms)' === 2025-08-04T20:04:38.525089Z error tf === Dumping Istio Deployment State for TestGateway/unmanaged... 2025-08-04T20:04:38.525093Z error tf === Dumping Namespace echo State for TestGateway/unmanaged... 2025-08-04T20:04:38.525107Z error tf === Dumping Namespace external State for TestGateway/unmanaged... 2025-08-04T20:04:38.847109Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/4506c6841f0-8a92-4227-bd68-225c729af4b6 2025-08-04T20:04:38.847252Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3220s 2025-08-04T20:04:38.848096Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:39.073968Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/45023676008-dba7-42ba-af2f-7d14f4b03d7a 2025-08-04T20:04:39.074073Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5487s 2025-08-04T20:04:39.075022Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:39.269045Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/4509525d3ad-b003-46cb-bcc3-f73aaa3ed561 2025-08-04T20:04:39.269200Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.7438s 2025-08-04T20:04:39.270200Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:39.582686Z error tf === Dumping Namespace istio-system State for TestGateway/unmanaged... --- FAIL: TestGateway/unmanaged (1.91s) FAIL tests/integration/pilot.TestGateway/unmanaged (re-run 2) (1.91s) === RUN TestGateway 2025-08-04T20:04:38.419215Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:04:40.327519Z info tf === DONE (failed): Test: 'pilot[TestGateway] (1.908299643s)' === 2025-08-04T20:04:40.327624Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:04:40.327634Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:04:40.327643Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:04:40.656429Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/450dc8cf574-bbe1-4c12-bb7e-367032a5c252 2025-08-04T20:04:40.656710Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3287s 2025-08-04T20:04:40.657383Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:40.797424Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/4508a1ada96-d784-442e-9672-5443db901574 2025-08-04T20:04:40.797586Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4694s 2025-08-04T20:04:40.798372Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:40.956233Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/450435b623b-93c0-4084-a578-4c7ffe18bdff 2025-08-04T20:04:40.956425Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6282s 2025-08-04T20:04:40.957241Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestGateway (2.96s) FAIL tests/integration/pilot.TestGateway (re-run 2) (2.96s) 2025-08-04T20:04:41.376542Z info tf === FAILED: Test Run: 'pilot' (exitCode: 1) === 2025-08-04T20:04:41.376608Z info tf === Suite "pilot" run time: 42.641331939s === 2025-08-04T20:04:41.376626Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/trace.yaml 2025-08-04T20:04:41.376811Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:04:41.376829Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:04:41.376811Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:04:41.648445Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/450332d5e0d-f112-443f-b83f-9e4c528b0adc 2025-08-04T20:04:41.648689Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2717s 2025-08-04T20:04:41.649591Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:41.772467Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/450b6c00bca-d4bb-46d4-b2f9-3dd1c2e3c352 2025-08-04T20:04:41.772574Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3955s 2025-08-04T20:04:41.773354Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:41.909162Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/450fbbc93de-9211-4e0b-b54f-3f6fd357325f 2025-08-04T20:04:41.909363Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5323s 2025-08-04T20:04:41.910032Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:42.317850Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:04:42.317950Z info tf === SUCCEEDED: Cleanup Istio in 96.838µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^tagged$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 858396 2025-08-04T20:04:55.148437Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:04:55.148490Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:04:55.190521Z info tf === Test Framework Settings === 2025-08-04T20:04:55.190685Z info tf TestID: pilot RunID: c1f5785d-7c2e-49de-ab57-443de6cc7c7c NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:04:55.190694Z info tf =============================== 2025-08-04T20:04:55.190915Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-c1f5785d7c2e49deab57443de 2025-08-04T20:04:55.191028Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:04:55.191047Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:04:55.191073Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:04:55.191086Z info tf === BEGIN: Building clusters === 2025-08-04T20:04:55.197003Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:04:55.197021Z info tf === DONE: Building clusters === 2025-08-04T20:04:55.197061Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:04:55.197095Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:04:55.197104Z info tf === Istio Component Config === 2025-08-04T20:04:55.197145Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:04:55.197150Z info tf ================================ 2025-08-04T20:04:55.200094Z info tf skipping deployment as specified in the config 2025-08-04T20:04:55.200113Z info tf === SUCCEEDED: Deploy Istio in 3.011511ms [Suite=pilot]=== 2025-08-04T20:04:55.200247Z info tf === BEGIN: Create namespace external === 2025-08-04T20:04:55.200270Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:04:55.227672Z info tf === SUCCEEDED: Create namespace echo in 27.41858ms === 2025-08-04T20:04:55.236421Z info tf === SUCCEEDED: Create namespace external in 36.191959ms === 2025-08-04T20:04:55.307081Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:04:55.331921Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:04:55.332008Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-c1f5785d7c2e49deab57443de/_suite_context/Service.3030378426.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:04:55.332053Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:04:55.332087Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:04:55.332088Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:04:55.581901Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:55.593015Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:55.593015Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:55.593070Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:55.593475Z error klog an error occurred forwarding 42725 -> 15000: error forwarding port 15000 to pod 7b9ee6b4045f29bd9e49242802811e26f7a9c3a3656da61e041bbee983d58ae4, uid : port forward into network namespace "/var/run/netns/4360bc9e-df25-4aef-871c-d0dab2932472": failed to connect to localhost:15000 inside namespace 7b9ee6b4045f29bd9e49242802811e26f7a9c3a3656da61e041bbee983d58ae4: dial tcp [::1]:15000: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:04:55.595282Z error tf Unable to get execute command "config_dump?include_eds=true" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-5wlh4 for: Get "http://localhost:42725/config_dump?include_eds=true": EOF 2025-08-04T20:04:55.595313Z error port forward failed: lost connection to pod 2025-08-04T20:04:55.596037Z error tf Unable to get execute command "clusters" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-5wlh4 for: Get "http://localhost:42725/clusters": dial tcp 127.0.0.1:42725: connect: connection refused 2025-08-04T20:04:55.597682Z error klog an error occurred forwarding 37443 -> 15020: error forwarding port 15020 to pod 2a54c4774c4333554f38af100e0e4f93cec7463c1cf9f0e0d3d76c94353d6bba, uid : port forward into network namespace "/var/run/netns/4a34bf98-c28e-425c-88c5-d11b0c2a5b26": failed to connect to localhost:15020 inside namespace 2a54c4774c4333554f38af100e0e4f93cec7463c1cf9f0e0d3d76c94353d6bba: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:04:55.599431Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-6ng8z for: Get "http://localhost:37443/debug/ndsz": EOF 2025-08-04T20:04:55.599526Z error port forward failed: lost connection to pod 2025-08-04T20:04:55.600151Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-6ng8z for: Get "http://localhost:37443/stats/prometheus": dial tcp 127.0.0.1:37443: connect: connection refused 2025-08-04T20:04:55.612837Z error klog an error occurred forwarding 43657 -> 15000: error forwarding port 15000 to pod 2a54c4774c4333554f38af100e0e4f93cec7463c1cf9f0e0d3d76c94353d6bba, uid : port forward into network namespace "/var/run/netns/4a34bf98-c28e-425c-88c5-d11b0c2a5b26": failed to connect to localhost:15000 inside namespace 2a54c4774c4333554f38af100e0e4f93cec7463c1cf9f0e0d3d76c94353d6bba: dial tcp [::1]:15000: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:04:55.614518Z error tf Unable to get execute command "config_dump?include_eds=true" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-6ng8z for: Get "http://localhost:43657/config_dump?include_eds=true": EOF 2025-08-04T20:04:55.614504Z error port forward failed: lost connection to pod 2025-08-04T20:04:55.615499Z error tf Unable to get execute command "clusters" on cluster/pod: cluster-0/echo/b-v1-5bccd7df8d-6ng8z for: Get "http://localhost:43657/clusters": dial tcp 127.0.0.1:43657: connect: connection refused 2025-08-04T20:04:55.635266Z error klog an error occurred forwarding 35707 -> 15000: error forwarding port 15000 to pod e79feca186e33da10d530af7149cf876f92d4d94e6b10f98ef1bf28ece360866, uid : port forward into network namespace "/var/run/netns/6ce10314-a165-4e03-af39-b80084b89d0d": failed to connect to localhost:15000 inside namespace e79feca186e33da10d530af7149cf876f92d4d94e6b10f98ef1bf28ece360866: dial tcp [::1]:15000: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:04:55.636933Z error tf Unable to get execute command "config_dump?include_eds=true" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-rdfd4 for: Get "http://localhost:35707/config_dump?include_eds=true": EOF 2025-08-04T20:04:55.637035Z error port forward failed: lost connection to pod 2025-08-04T20:04:55.637570Z error tf Unable to get execute command "clusters" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-rdfd4 for: Get "http://localhost:35707/clusters": dial tcp 127.0.0.1:35707: connect: connection refused 2025-08-04T20:04:55.660454Z error klog an error occurred forwarding 35603 -> 15020: error forwarding port 15020 to pod e79feca186e33da10d530af7149cf876f92d4d94e6b10f98ef1bf28ece360866, uid : port forward into network namespace "/var/run/netns/6ce10314-a165-4e03-af39-b80084b89d0d": failed to connect to localhost:15020 inside namespace e79feca186e33da10d530af7149cf876f92d4d94e6b10f98ef1bf28ece360866: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:04:55.661058Z error klog an error occurred forwarding 34717 -> 15020: error forwarding port 15020 to pod 7b9ee6b4045f29bd9e49242802811e26f7a9c3a3656da61e041bbee983d58ae4, uid : port forward into network namespace "/var/run/netns/4360bc9e-df25-4aef-871c-d0dab2932472": failed to connect to localhost:15020 inside namespace 7b9ee6b4045f29bd9e49242802811e26f7a9c3a3656da61e041bbee983d58ae4: dial tcp [::1]:15020: connect: connection refused: Unhandled Error logger=UnhandledError 2025-08-04T20:04:55.662116Z error port forward failed: lost connection to pod 2025-08-04T20:04:55.662106Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-rdfd4 for: Get "http://localhost:35603/debug/ndsz": EOF 2025-08-04T20:04:55.662629Z error port forward failed: lost connection to pod 2025-08-04T20:04:55.662643Z error tf Unable to get execute command "debug/ndsz" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-5wlh4 for: Get "http://localhost:34717/debug/ndsz": EOF 2025-08-04T20:04:55.663109Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/sotw-v1-c494d6b8d-rdfd4 for: Get "http://localhost:35603/stats/prometheus": dial tcp 127.0.0.1:35603: connect: connection refused 2025-08-04T20:04:55.663379Z error tf Unable to get execute command "stats/prometheus" on cluster/pod: cluster-0/echo/headless-v1-5455bcc7b9-5wlh4 for: Get "http://localhost:34717/stats/prometheus": dial tcp 127.0.0.1:34717: connect: connection refused 2025-08-04T20:04:55.700844Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:50Z/453f1446795-1a96-4e38-b844-731b027f4f6d 2025-08-04T20:04:55.700953Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3686s 2025-08-04T20:04:55.701745Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:55.713291Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:55.734522Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:55.776578Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:55.777341Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:55.839635Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:55.855424Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:55.908585Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:55.920922Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:55.932142Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:50Z/45370db63f7-330d-430e-9544-4582b270698e 2025-08-04T20:04:55.932276Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5999s 2025-08-04T20:04:55.933054Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:55.965394Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:55.971048Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.012139Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.023617Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.069989Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.092448Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.104414Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:50Z/4537c9bf16a-fb07-42b1-82a6-13cc8a891126 2025-08-04T20:04:56.104854Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.7725s 2025-08-04T20:04:56.106122Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:56.114375Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.122175Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.124482Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:04:56.133082Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:04:56.138520Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-c1f5785d7c2e49deab57443de/_suite_context/Service.3030378426.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:04:56.138580Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-c1f5785d7c2e49deab57443de/_suite_context/Service.3030378426.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated) === 2025-08-04T20:04:56.138590Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-c1f5785d7c2e49deab57443de/_suite_context/Service.3030378426.yaml] to ns external in cluster cluster-0: apply: patch: services "external" is forbidden: unable to create new content in namespace external because it is being terminated 2025-08-04T20:04:56.138642Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:04:56.138643Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:04:56.138684Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:04:56.332202Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.344778Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.358493Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.359493Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.362218Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.365940Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.385109Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.388686Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.420725Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.422806Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.482641Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:50Z/4539a530f71-bc27-4ecf-944d-745a76c2366e 2025-08-04T20:04:56.482817Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3438s 2025-08-04T20:04:56.483543Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:56.486608Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.535037Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.546815Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.546816Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.562225Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.571541Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.582830Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.600741Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.635505Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.656758Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.676740Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.710880Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.724323Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.725152Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.739703Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.758377Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.786750Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.793700Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.794696Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.799755Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.806640Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:50Z/45306c33fc6-ea18-4b68-944f-564d51eb0e2a 2025-08-04T20:04:56.806810Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.6678s 2025-08-04T20:04:56.807358Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:56.842425Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.869027Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.874288Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.874874Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.882991Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:56.931063Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.937073Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:56.937503Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:56.940907Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:56.975118Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:56.989314Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:57.009774Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:57.010725Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:50Z/453d1fddfb7-6648-4752-92fc-6986041933c4 2025-08-04T20:04:57.010812Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.8718s 2025-08-04T20:04:57.011450Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:57.018677Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:57.021598Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("sotw-v1-c494d6b8d-rdfd4_echo") 2025-08-04T20:04:57.033040Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:57.052369Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("b-v1-5bccd7df8d-6ng8z_echo") 2025-08-04T20:04:57.052369Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:57.056105Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("c-v1-5f56c57bb9-gvtz2_echo") 2025-08-04T20:04:57.059203Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("a-v1-6b586f9d47-vpzc9_echo") 2025-08-04T20:04:57.062515Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:04:57.078915Z error port forward failed: error upgrading connection: unable to upgrade connection: pod not found ("headless-v1-5455bcc7b9-5wlh4_echo") 2025-08-04T20:04:57.089394Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:04:57.093363Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:04:57.093394Z info tf === SUCCEEDED: Cleanup Istio in 24.053µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^tagged$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 859909 2025-08-04T20:05:11.433824Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:05:11.433874Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:05:11.468049Z info tf === Test Framework Settings === 2025-08-04T20:05:11.468143Z info tf TestID: pilot RunID: 4aa08021-96ab-4844-9b02-9e51e3239120 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:05:11.468149Z info tf =============================== 2025-08-04T20:05:11.468327Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-4aa0802196ab48449b029e51e 2025-08-04T20:05:11.468413Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:05:11.468425Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:05:11.468444Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:05:11.468453Z info tf === BEGIN: Building clusters === 2025-08-04T20:05:11.475102Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:05:11.475200Z info tf === DONE: Building clusters === 2025-08-04T20:05:11.475230Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:05:11.475270Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:05:11.475280Z info tf === Istio Component Config === 2025-08-04T20:05:11.475329Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:05:11.475336Z info tf ================================ 2025-08-04T20:05:11.478756Z info tf skipping deployment as specified in the config 2025-08-04T20:05:11.478776Z info tf === SUCCEEDED: Deploy Istio in 3.500068ms [Suite=pilot]=== 2025-08-04T20:05:11.478880Z info tf === BEGIN: Create namespace external === 2025-08-04T20:05:11.478884Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:05:11.496293Z info tf === SUCCEEDED: Create namespace echo in 17.41608ms === 2025-08-04T20:05:11.519090Z info tf === SUCCEEDED: Create namespace external in 40.222296ms === 2025-08-04T20:05:11.587175Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:05:11.620725Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:05:11.620757Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-4aa0802196ab48449b029e51e/_suite_context/ServiceAccount-Service.2686712651.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:05:11.620823Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:05:11.620826Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:05:11.620863Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:05:11.760330Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:11.773722Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:11.777338Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-4aa0802196ab48449b029e51e/_suite_context/ServiceAccount-Service.2686712651.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:05:11.777403Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-4aa0802196ab48449b029e51e/_suite_context/ServiceAccount-Service.2686712651.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-08-04T20:05:11.777414Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-4aa0802196ab48449b029e51e/_suite_context/ServiceAccount-Service.2686712651.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "statefulset" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:05:11.777456Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:05:11.777459Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:05:11.777501Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:05:11.821581Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:05:11Z/4542e60474d-275f-4a1e-b91b-ea8eaa21f466 2025-08-04T20:05:11.821779Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2006s 2025-08-04T20:05:11.822495Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:05:11.902298Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:11.908556Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:11.938562Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:05:11.938642Z info tf === SUCCEEDED: Cleanup Istio in 71.015µs [Suite=pilot] === FAIL tests/integration/pilot exec: [go test -json -test.run=^TestGateway$/^status$ -tags=integ -timeout 180m istio.io/istio/tests/integration/pilot -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts -test.skip TestCustomGateway/helm.*|TestCNIRaceRepair|TestValidation|TestWebhook|TestTraffic/gateway/cipher_suite] go test pid: 861253 2025-08-04T20:05:26.663635Z warn unable to resolve TARGET_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:05:26.663696Z warn unable to resolve LOCAL_OUT. Dir /root/mohit/istio/out/linux_ppc64le does not exist 2025-08-04T20:05:26.701280Z info tf === Test Framework Settings === 2025-08-04T20:05:26.701449Z info tf TestID: pilot RunID: 2d7bdaf3-d825-4c2a-b39c-41ea9a82f356 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-08-04T20:05:26.701458Z info tf =============================== 2025-08-04T20:05:26.701669Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-2d7bdaf3d8254c2ab39c41ea9 2025-08-04T20:05:26.701770Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-08-04T20:05:26.701788Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-08-04T20:05:26.701812Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-08-04T20:05:26.701825Z info tf === BEGIN: Building clusters === 2025-08-04T20:05:26.708194Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-08-04T20:05:26.708243Z info tf === DONE: Building clusters === 2025-08-04T20:05:26.708277Z info tf === BEGIN: Setup: 'pilot' === 2025-08-04T20:05:26.708304Z info tf === BEGIN: Deploy Istio [Suite=pilot] === 2025-08-04T20:05:26.708311Z info tf === Istio Component Config === 2025-08-04T20:05:26.708363Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-08-04T20:05:26.708369Z info tf ================================ 2025-08-04T20:05:26.711216Z info tf skipping deployment as specified in the config 2025-08-04T20:05:26.711235Z info tf === SUCCEEDED: Deploy Istio in 2.924557ms [Suite=pilot]=== 2025-08-04T20:05:26.711322Z info tf === BEGIN: Create namespace external === 2025-08-04T20:05:26.711342Z info tf === BEGIN: Create namespace echo === 2025-08-04T20:05:26.733059Z info tf === SUCCEEDED: Create namespace echo in 21.711956ms === 2025-08-04T20:05:26.736559Z info tf === SUCCEEDED: Create namespace external in 25.249573ms === 2025-08-04T20:05:26.857160Z info tf === BEGIN: Deploy echo instances === 2025-08-04T20:05:26.900305Z error tf === FAILED: Deploy echo instances === 2025-08-04T20:05:26.900367Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-2d7bdaf3d8254c2ab39c41ea9/_suite_context/ServiceAccount-Service.1740090268.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:05:26.900445Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:05:26.900453Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:05:26.900460Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:05:27.078578Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:27.078612Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:27.089383Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-2d7bdaf3d8254c2ab39c41ea9/_suite_context/ServiceAccount-Service.1740090268.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:05:27.089434Z info tf === FAILED: Setup: 'pilot' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-2d7bdaf3d8254c2ab39c41ea9/_suite_context/ServiceAccount-Service.1740090268.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-08-04T20:05:27.089442Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-2d7bdaf3d8254c2ab39c41ea9/_suite_context/ServiceAccount-Service.1740090268.yaml] to ns echo in cluster cluster-0: apply: patch: serviceaccounts "sotw" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-08-04T20:05:27.089474Z error tf === Dumping Namespace echo State for [suite(pilot)]... 2025-08-04T20:05:27.089486Z error tf === Dumping Istio Deployment State for [suite(pilot)]... 2025-08-04T20:05:27.089500Z error tf === Dumping Namespace external State for [suite(pilot)]... 2025-08-04T20:05:27.134382Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:05:27Z/456855dfe5c-e784-4d5a-adb3-1ca764b93fa2 2025-08-04T20:05:27.134534Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2337s 2025-08-04T20:05:27.135270Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:05:27.230730Z error tf failed to dump ndsz: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:27.236637Z error tf dump failed: hit max attempts 5 attempts (last error: failure running port forward process: building port forwarded: pod is not running. Status=Succeeded) 2025-08-04T20:05:27.263974Z info tf === BEGIN: Cleanup Istio [Suite=pilot] === 2025-08-04T20:05:27.264128Z info tf === SUCCEEDED: Cleanup Istio in 143.557µs [Suite=pilot] === FAIL tests/integration/pilot === Skipped === SKIP: tests/integration/pilot TestTimeout (0.00s) analyze_test.go:323: https://github.com/istio/istio/issues/25893 === SKIP: tests/integration/pilot TestMultiClusterWithSecrets (0.00s) 2025-08-04T19:43:05.183409Z info tf === BEGIN: Test: 'pilot[TestMultiClusterWithSecrets]' === analyze_test.go:447: skipping test, need at least 2 clusters 2025-08-04T19:43:05.183474Z info tf === DONE (skipped): Test: 'pilot[TestMultiClusterWithSecrets] (64.306µs)' === === SKIP: tests/integration/pilot TestMultiClusterWithContexts (0.00s) 2025-08-04T19:43:05.183707Z info tf === BEGIN: Test: 'pilot[TestMultiClusterWithContexts]' === analyze_test.go:518: skipping test, need at least 2 clusters 2025-08-04T19:43:05.183748Z info tf === DONE (skipped): Test: 'pilot[TestMultiClusterWithContexts] (39.471µs)' === === SKIP: tests/integration/pilot TestRevisionTraffic (0.00s) cross_revision_test.go:41: ISTIO_TEST_EXTRA_REVISIONS not specified === SKIP: tests/integration/pilot TestDualStackEndpointLoadBalancer (0.00s) test.go:258: Skipping "TestDualStackEndpointLoadBalancer": context does not have DualStack configuration === SKIP: tests/integration/pilot TestRemoteClusters (0.00s) test.go:245: Skipping "TestRemoteClusters": number of clusters 1 is below required min 2 === SKIP: tests/integration/pilot TestMultiVersionRevision (0.00s) 2025-08-04T19:45:30.359578Z info tf === BEGIN: Test: 'pilot[TestMultiVersionRevision]' === multi_version_revision_test.go:66: https://github.com/istio/istio/pull/46213 2025-08-04T19:45:30.359615Z info tf === DONE (skipped): Test: 'pilot[TestMultiVersionRevision] (35.75µs)' === === SKIP: tests/integration/pilot TestClusterLocal (0.00s) test.go:245: Skipping "TestClusterLocal": number of clusters 1 is below required min 2 === SKIP: tests/integration/pilot TestBadRemoteSecret (0.00s) test.go:245: Skipping "TestBadRemoteSecret": number of clusters 1 is below required min 2 === SKIP: tests/integration/pilot TestTproxy (0.00s) 2025-08-04T19:45:30.360151Z info tf === BEGIN: Test: 'pilot[TestTproxy]' === original_src_addr_test.go:35: 2025-08-04T19:45:30.360180Z info tf === DONE (skipped): Test: 'pilot[TestTproxy] (27.692µs)' === === SKIP: tests/integration/pilot TestRevisionedUpgrade (0.00s) 2025-08-04T19:45:40.985068Z info tf === BEGIN: Test: 'pilot[TestRevisionedUpgrade]' === revisioned_upgrade_test.go:54: https://github.com/istio/istio/pull/46213 2025-08-04T19:45:40.985129Z info tf === DONE (skipped): Test: 'pilot[TestRevisionedUpgrade] (59.902µs)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/naked.echo/to_b.echo (0.02s) 2025-08-04T19:46:06.007206Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_b.echo]' === run.go:90: cases from naked in primary-0 with b as destination are removed by filters 2025-08-04T19:46:06.029705Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_b.echo] (22.490181ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/naked.echo/to_external.external (0.02s) 2025-08-04T19:46:06.030256Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_external.external]' === run.go:90: cases from naked in primary-0 with external as destination are removed by filters 2025-08-04T19:46:06.046661Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_external.external] (16.398463ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/naked.echo/to_headless.echo (0.01s) 2025-08-04T19:46:06.047042Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_headless.echo]' === run.go:90: cases from naked in primary-0 with headless as destination are removed by filters 2025-08-04T19:46:06.061743Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_headless.echo] (14.692644ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/naked.echo/to_naked.echo (0.01s) 2025-08-04T19:46:06.062227Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_naked.echo]' === run.go:90: cases from naked in primary-0 with naked as destination are removed by filters 2025-08-04T19:46:06.073251Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_naked.echo] (11.016929ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/naked.echo/to_statefulset.echo (0.01s) 2025-08-04T19:46:06.073652Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_statefulset.echo]' === run.go:90: cases from naked in primary-0 with statefulset as destination are removed by filters 2025-08-04T19:46:06.085099Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/naked.echo/to_statefulset.echo] (11.435752ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/proxyless-grpc.echo/to_external.external (0.01s) 2025-08-04T19:46:06.135800Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/proxyless-grpc.echo/to_external.external]' === run.go:90: cases from proxyless-grpc in primary-0 with external as destination are removed by filters 2025-08-04T19:46:06.149361Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/proxyless-grpc.echo/to_external.external] (13.553209ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/proxyless-grpc.echo/to_headless.echo (0.02s) 2025-08-04T19:46:06.149750Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/proxyless-grpc.echo/to_headless.echo]' === run.go:90: cases from proxyless-grpc in primary-0 with headless as destination are removed by filters 2025-08-04T19:46:06.170079Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/proxyless-grpc.echo/to_headless.echo] (20.320858ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/http/proxyless-grpc.echo/to_statefulset.echo (0.01s) 2025-08-04T19:46:06.210799Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/http/proxyless-grpc.echo/to_statefulset.echo]' === run.go:90: cases from proxyless-grpc in primary-0 with statefulset as destination are removed by filters 2025-08-04T19:46:06.224849Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/http/proxyless-grpc.echo/to_statefulset.echo] (14.044023ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/naked.echo/to_b.echo (0.02s) 2025-08-04T19:46:06.966606Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_b.echo]' === run.go:90: cases from naked in primary-0 with b as destination are removed by filters 2025-08-04T19:46:06.984032Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_b.echo] (17.42222ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/naked.echo/to_external.external (0.01s) 2025-08-04T19:46:06.984436Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_external.external]' === run.go:90: cases from naked in primary-0 with external as destination are removed by filters 2025-08-04T19:46:06.996002Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_external.external] (11.564484ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/naked.echo/to_headless.echo (0.02s) 2025-08-04T19:46:06.996250Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_headless.echo]' === run.go:90: cases from naked in primary-0 with headless as destination are removed by filters 2025-08-04T19:46:07.011948Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_headless.echo] (15.695092ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/naked.echo/to_naked.echo (0.01s) 2025-08-04T19:46:07.012218Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_naked.echo]' === run.go:90: cases from naked in primary-0 with naked as destination are removed by filters 2025-08-04T19:46:07.024486Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_naked.echo] (12.264648ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/naked.echo/to_statefulset.echo (0.02s) 2025-08-04T19:46:07.024762Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_statefulset.echo]' === run.go:90: cases from naked in primary-0 with statefulset as destination are removed by filters 2025-08-04T19:46:07.040394Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/naked.echo/to_statefulset.echo] (15.626619ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_external.external (0.02s) 2025-08-04T19:46:07.089877Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_external.external]' === run.go:90: cases from proxyless-grpc in primary-0 with external as destination are removed by filters 2025-08-04T19:46:07.109420Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_external.external] (19.529144ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_headless.echo (0.02s) 2025-08-04T19:46:07.110192Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_headless.echo]' === run.go:90: cases from proxyless-grpc in primary-0 with headless as destination are removed by filters 2025-08-04T19:46:07.126900Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_headless.echo] (16.700212ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_statefulset.echo (0.02s) 2025-08-04T19:46:07.166754Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_statefulset.echo]' === run.go:90: cases from proxyless-grpc in primary-0 with statefulset as destination are removed by filters 2025-08-04T19:46:07.182186Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing/auto-http/proxyless-grpc.echo/to_statefulset.echo] (15.41806ms)' === === SKIP: tests/integration/pilot TestTraffic/sniffing (2.06s) 2025-08-04T19:46:05.329453Z info tf === BEGIN: Test: 'pilot[TestTraffic/sniffing]' === traffic.go:98: https://github.com/istio/istio/issues/26798: enable sniffing tcp 2025-08-04T19:46:07.385231Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/sniffing] (2.055776144s)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_service/a.echo/to_b.echo (0.02s) 2025-08-04T19:46:07.481675Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_b.echo]' === run.go:90: cases from a in primary-0 with b as destination are removed by filters 2025-08-04T19:46:07.505547Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_b.echo] (23.860699ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_service/a.echo/to_external.external (0.02s) 2025-08-04T19:46:07.506322Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_external.external]' === run.go:90: cases from a in primary-0 with external as destination are removed by filters 2025-08-04T19:46:07.524539Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_external.external] (18.202655ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_service/a.echo/to_headless.echo (0.02s) 2025-08-04T19:46:07.525322Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_headless.echo]' === run.go:90: cases from a in primary-0 with headless as destination are removed by filters 2025-08-04T19:46:07.544313Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_headless.echo] (18.978357ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_service/a.echo/to_naked.echo (0.02s) 2025-08-04T19:46:07.545086Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_naked.echo]' === run.go:90: cases from a in primary-0 with naked as destination are removed by filters 2025-08-04T19:46:07.567316Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_naked.echo] (22.223609ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_service/a.echo/to_statefulset.echo (0.02s) 2025-08-04T19:46:07.567766Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_statefulset.echo]' === run.go:90: cases from a in primary-0 with statefulset as destination are removed by filters 2025-08-04T19:46:07.582884Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_service/a.echo/to_statefulset.echo] (15.114425ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_localhost/a.echo/to_b.echo (0.01s) 2025-08-04T19:46:07.662298Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_b.echo]' === run.go:90: cases from a in primary-0 with b as destination are removed by filters 2025-08-04T19:46:07.676325Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_b.echo] (14.024585ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_localhost/a.echo/to_external.external (0.02s) 2025-08-04T19:46:07.676639Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_external.external]' === run.go:90: cases from a in primary-0 with external as destination are removed by filters 2025-08-04T19:46:07.695544Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_external.external] (18.901624ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_localhost/a.echo/to_headless.echo (0.01s) 2025-08-04T19:46:07.695776Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_headless.echo]' === run.go:90: cases from a in primary-0 with headless as destination are removed by filters 2025-08-04T19:46:07.710522Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_headless.echo] (14.743644ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_localhost/a.echo/to_naked.echo (0.03s) 2025-08-04T19:46:07.710859Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_naked.echo]' === run.go:90: cases from a in primary-0 with naked as destination are removed by filters 2025-08-04T19:46:07.735897Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_naked.echo] (25.034407ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_localhost/a.echo/to_statefulset.echo (0.02s) 2025-08-04T19:46:07.736260Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_statefulset.echo]' === run.go:90: cases from a in primary-0 with statefulset as destination are removed by filters 2025-08-04T19:46:07.754301Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_localhost/a.echo/to_statefulset.echo] (18.034215ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_podIP/a.echo/to_b.echo (0.02s) 2025-08-04T19:46:07.841631Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_b.echo]' === run.go:90: cases from a in primary-0 with b as destination are removed by filters 2025-08-04T19:46:07.862184Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_b.echo] (20.549013ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_podIP/a.echo/to_external.external (0.02s) 2025-08-04T19:46:07.862558Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_external.external]' === run.go:90: cases from a in primary-0 with external as destination are removed by filters 2025-08-04T19:46:07.878962Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_external.external] (16.399224ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_podIP/a.echo/to_headless.echo (0.02s) 2025-08-04T19:46:07.879310Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_headless.echo]' === run.go:90: cases from a in primary-0 with headless as destination are removed by filters 2025-08-04T19:46:07.896551Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_headless.echo] (17.229169ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_podIP/a.echo/to_naked.echo (0.02s) 2025-08-04T19:46:07.897140Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_naked.echo]' === run.go:90: cases from a in primary-0 with naked as destination are removed by filters 2025-08-04T19:46:07.912855Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_naked.echo] (15.705199ms)' === === SKIP: tests/integration/pilot TestTraffic/selfcall/to_podIP/a.echo/to_statefulset.echo (0.02s) 2025-08-04T19:46:07.913527Z info tf === BEGIN: Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_statefulset.echo]' === run.go:90: cases from a in primary-0 with statefulset as destination are removed by filters 2025-08-04T19:46:07.932818Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/selfcall/to_podIP/a.echo/to_statefulset.echo] (19.277418ms)' === === SKIP: tests/integration/pilot TestTraffic/externalname/service_entry (0.00s) 2025-08-04T19:46:32.279379Z info tf === BEGIN: Test: 'pilot[TestTraffic/externalname/service_entry]' === traffic.go:215: not currently working, as SE doesn't have a VIP 2025-08-04T19:46:32.279516Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/externalname/service_entry] (130.77µs)' === === SKIP: tests/integration/pilot TestTraffic/consistent-hash/http_cookie_with_ttla (0.00s) 2025-08-04T19:46:41.356469Z info tf === BEGIN: Test: 'pilot[TestTraffic/consistent-hash/http_cookie_with_ttla]' === traffic.go:215: https://github.com/istio/istio/issues/48156: not currently working, as test framework is not passing the cookies back 2025-08-04T19:46:41.356637Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/consistent-hash/http_cookie_with_ttla] (159.298µs)' === === SKIP: tests/integration/pilot TestTraffic/consistent-hash/http_cookie_without_ttla (0.00s) 2025-08-04T19:46:41.357138Z info tf === BEGIN: Test: 'pilot[TestTraffic/consistent-hash/http_cookie_without_ttla]' === traffic.go:215: https://github.com/istio/istio/issues/48156: not currently working, as test framework is not passing the cookies back 2025-08-04T19:46:41.357190Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/consistent-hash/http_cookie_without_ttla] (49.97µs)' === === SKIP: tests/integration/pilot TestTraffic/consistent-hash/http_cookie_with_ttlb (0.00s) 2025-08-04T19:46:42.786390Z info tf === BEGIN: Test: 'pilot[TestTraffic/consistent-hash/http_cookie_with_ttlb]' === traffic.go:215: https://github.com/istio/istio/issues/48156: not currently working, as test framework is not passing the cookies back 2025-08-04T19:46:42.786486Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/consistent-hash/http_cookie_with_ttlb] (89.41µs)' === === SKIP: tests/integration/pilot TestTraffic/consistent-hash/http_cookie_without_ttlb (0.00s) 2025-08-04T19:46:42.786847Z info tf === BEGIN: Test: 'pilot[TestTraffic/consistent-hash/http_cookie_without_ttlb]' === traffic.go:215: https://github.com/istio/istio/issues/48156: not currently working, as test framework is not passing the cookies back 2025-08-04T19:46:42.786886Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/consistent-hash/http_cookie_without_ttlb] (37.957µs)' === === SKIP: tests/integration/pilot TestTraffic/vm (0.00s) 2025-08-04T19:46:43.165276Z info tf === BEGIN: Test: 'pilot[TestTraffic/vm]' === routing.go:3748: VMs are disabled 2025-08-04T19:46:43.165415Z info tf === DONE (skipped): Test: 'pilot[TestTraffic/vm] (136.201µs)' === === SKIP: tests/integration/pilot TestVmOSPost (0.00s) 2025-08-04T19:57:02.021567Z info tf === BEGIN: Test: 'pilot[TestVmOSPost]' === vm_test.go:68: VM tests are disabled 2025-08-04T19:57:02.021615Z info tf === DONE (skipped): Test: 'pilot[TestVmOSPost] (46.5µs)' === === SKIP: tests/integration/pilot TestVMRegistrationLifecycle (0.00s) vm_test.go:98: https://github.com/istio/istio/issues/33154 === SKIP: tests/integration/pilot TestWorkloadEntryGateway (0.00s) test.go:245: Skipping "TestWorkloadEntryGateway": number of clusters 1 is below required min 2 === Failed === FAIL: tests/integration/pilot TestJsonInputFile (1.10s) 2025-08-04T19:42:55.770193Z info tf === BEGIN: Test: 'pilot[TestJsonInputFile]' === 2025-08-04T19:42:55.770212Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:42:55.778735Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 8.518532ms === analyze_test.go:178: apply: patch: gateways.networking.istio.io "httpbin-gateway-bogus" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:42:55.784831Z info tf === DONE (failed): Test: 'pilot[TestJsonInputFile] (14.635786ms)' === 2025-08-04T19:42:55.784868Z error tf === Dumping Namespace echo State for TestJsonInputFile... 2025-08-04T19:42:55.784888Z error tf === Dumping Istio Deployment State for TestJsonInputFile... 2025-08-04T19:42:55.784901Z error tf === Dumping Namespace external State for TestJsonInputFile... 2025-08-04T19:42:56.149237Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5628b0efdc-1c4a-4fa1-a2b8-de370da602d4 2025-08-04T19:42:56.149343Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3642s 2025-08-04T19:42:56.150112Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:56.757488Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56d25d2e97-f0de-4f27-893f-81f08edc646b 2025-08-04T19:42:56.757832Z info tf istioctl ([x internal-debug --all configz]): completed after 0.9726s 2025-08-04T19:42:56.758551Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:56.858804Z error tf === Dumping Namespace istioctl-analyze State for TestJsonInputFile... === FAIL: tests/integration/pilot TestJsonOutput/no_other_output_except_analysis_json_output (1.20s) 2025-08-04T19:42:56.883173Z info tf === BEGIN: Test: 'pilot[TestJsonOutput/no_other_output_except_analysis_json_output]' === analyze_test.go:201: apply: patch: gateways.networking.istio.io "httpbin-gateway-bogus" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:42:56.891118Z info tf === DONE (failed): Test: 'pilot[TestJsonOutput/no_other_output_except_analysis_json_output] (7.93815ms)' === 2025-08-04T19:42:56.891230Z error tf === Dumping Namespace echo State for TestJsonOutput/no_other_output_except_analysis_json_output... 2025-08-04T19:42:56.891261Z error tf === Dumping Namespace external State for TestJsonOutput/no_other_output_except_analysis_json_output... 2025-08-04T19:42:56.891271Z error tf === Dumping Istio Deployment State for TestJsonOutput/no_other_output_except_analysis_json_output... 2025-08-04T19:42:56.950797Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5615631a58-8764-4cf1-a06a-46eca01e32ba 2025-08-04T19:42:56.950978Z info tf istioctl ([x internal-debug --all clusterz]): completed after 1.1658s 2025-08-04T19:42:56.951614Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:57.215552Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56c1c48225-2bbf-4518-974a-6afece70e354 2025-08-04T19:42:57.215728Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3239s 2025-08-04T19:42:57.216665Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:57.365740Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/561decd976-da90-476e-8c00-af2c6e701d8e 2025-08-04T19:42:57.365953Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4741s 2025-08-04T19:42:57.366994Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestJsonOutput (2.99s) 2025-08-04T19:42:56.874262Z info tf === BEGIN: Test: 'pilot[TestJsonOutput]' === 2025-08-04T19:42:56.874335Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:42:56.882550Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 8.195749ms === 2025-08-04T19:42:58.190252Z info tf === DONE (failed): Test: 'pilot[TestJsonOutput] (1.315990921s)' === 2025-08-04T19:42:58.190309Z error tf === Dumping Namespace echo State for TestJsonOutput... 2025-08-04T19:42:58.190326Z error tf === Dumping Namespace external State for TestJsonOutput... 2025-08-04T19:42:58.190343Z error tf === Dumping Istio Deployment State for TestJsonOutput... 2025-08-04T19:42:58.598209Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5660d82e14-291a-4b88-b9f4-8d5226654ad7 2025-08-04T19:42:58.598379Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4077s 2025-08-04T19:42:58.598920Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:58.910444Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56a9eb5f8c-d1fc-439b-bcd1-ee47cac594a1 2025-08-04T19:42:58.910578Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.7199s 2025-08-04T19:42:58.911460Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:59.102757Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56c0ed80df-59f0-451a-8612-ed72d5150a41 2025-08-04T19:42:59.102885Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.9121s 2025-08-04T19:42:59.103469Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:42:59.847142Z error tf === Dumping Namespace istioctl-analyze State for TestJsonOutput... === FAIL: tests/integration/pilot TestKubeOnly (1.09s) 2025-08-04T19:42:59.864513Z info tf === BEGIN: Test: 'pilot[TestKubeOnly]' === 2025-08-04T19:42:59.864590Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:42:59.884875Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 20.277939ms === analyze_test.go:228: apply: patch: gateways.networking.istio.io "httpbin-gateway-bogus" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:42:59.889451Z info tf === DONE (failed): Test: 'pilot[TestKubeOnly] (24.936323ms)' === 2025-08-04T19:42:59.889515Z error tf === Dumping Namespace echo State for TestKubeOnly... 2025-08-04T19:42:59.889546Z error tf === Dumping Istio Deployment State for TestKubeOnly... 2025-08-04T19:42:59.889555Z error tf === Dumping Namespace external State for TestKubeOnly... 2025-08-04T19:43:00.198851Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56ede57931-9adb-48b9-bb73-1a4b0e1617d9 2025-08-04T19:43:00.199033Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3093s 2025-08-04T19:43:00.199875Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:00.349161Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56907db301-456f-42f0-a192-01ba2356a68e 2025-08-04T19:43:00.349351Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4595s 2025-08-04T19:43:00.350190Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:00.511868Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/5631960048-bd09-4335-ae8e-56efcace778d 2025-08-04T19:43:00.512025Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6222s 2025-08-04T19:43:00.512852Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:00.942855Z error tf === Dumping Namespace istioctl-analyze State for TestKubeOnly... === FAIL: tests/integration/pilot TestFileAndKubeCombined (1.91s) 2025-08-04T19:43:00.956572Z info tf === BEGIN: Test: 'pilot[TestFileAndKubeCombined]' === 2025-08-04T19:43:00.956637Z info tf === BEGIN: Create namespace istioctl-analyze === 2025-08-04T19:43:00.982927Z info tf === SUCCEEDED: Create namespace istioctl-analyze in 26.280591ms === analyze_test.go:252: apply: patch: virtualservices.networking.istio.io "reviews" is forbidden: unable to create new content in namespace istioctl-analyze because it is being terminated 2025-08-04T19:43:01.027664Z info tf === DONE (failed): Test: 'pilot[TestFileAndKubeCombined] (71.0889ms)' === 2025-08-04T19:43:01.027725Z error tf === Dumping Namespace echo State for TestFileAndKubeCombined... 2025-08-04T19:43:01.027792Z error tf === Dumping Namespace external State for TestFileAndKubeCombined... 2025-08-04T19:43:01.027771Z error tf === Dumping Istio Deployment State for TestFileAndKubeCombined... 2025-08-04T19:43:02.256643Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56659ddd60-306d-47a0-a498-dccc1c6014bf 2025-08-04T19:43:02.256907Z info tf istioctl ([x internal-debug --all configz]): completed after 1.2287s 2025-08-04T19:43:02.257731Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:02.603411Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/565241af20-8822-45ce-a586-7b233a4dc321 2025-08-04T19:43:02.603645Z info tf istioctl ([x internal-debug --all mcsz]): completed after 1.5754s 2025-08-04T19:43:02.604429Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:02.758046Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:42:53Z/56982d1a5a-e6b2-405d-b7d2-fca1f1935cd1 2025-08-04T19:43:02.758201Z info tf istioctl ([x internal-debug --all clusterz]): completed after 1.7300s 2025-08-04T19:43:02.758921Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:02.852145Z error tf === Dumping Namespace istioctl-analyze State for TestFileAndKubeCombined... === FAIL: tests/integration/pilot TestGatewayConformance (2.18s) 2025-08-04T19:43:13.522642Z info tf === BEGIN: Test: 'pilot[TestGatewayConformance]' === gateway_conformance_test.go:158: expected no error but got: no Gateway API CRDs with the proper annotations found in the cluster 2025-08-04T19:43:14.494077Z info tf === DONE (failed): Test: 'pilot[TestGatewayConformance] (971.429989ms)' === 2025-08-04T19:43:14.494160Z error tf === Dumping Namespace echo State for TestGatewayConformance... 2025-08-04T19:43:14.494182Z error tf === Dumping Istio Deployment State for TestGatewayConformance... 2025-08-04T19:43:14.494193Z error tf === Dumping Namespace external State for TestGatewayConformance... 2025-08-04T19:43:14.876837Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/618cc681ce-24ca-4e96-952f-7fbb1d51c076 2025-08-04T19:43:14.877187Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3826s 2025-08-04T19:43:14.877731Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:15.010361Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/616b02f135-12f3-40cb-8da1-86f319ce18db 2025-08-04T19:43:15.010455Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5159s 2025-08-04T19:43:15.011177Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:15.179824Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61d2099914-b0f0-4cf6-8e30-0a34d635a6c1 2025-08-04T19:43:15.179956Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6854s 2025-08-04T19:43:15.180791Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:15.648986Z error tf === Dumping Namespace gateway-conformance-infra State for TestGatewayConformance... 2025-08-04T19:43:15.655919Z error tf === Dumping Namespace gateway-conformance-mesh State for TestGatewayConformance... 2025-08-04T19:43:15.661477Z error tf === Dumping Namespace gateway-conformance-mesh-consumer State for TestGatewayConformance... 2025-08-04T19:43:15.677348Z error tf === Dumping Namespace gateway-conformance-app-backend State for TestGatewayConformance... 2025-08-04T19:43:15.683494Z error tf === Dumping Namespace gateway-conformance-web-backend State for TestGatewayConformance... === FAIL: tests/integration/pilot TestGateway/unmanaged (2.41s) 2025-08-04T19:43:15.700672Z info tf === BEGIN: Test: 'pilot[TestGateway/unmanaged]' === gateway_test.go:621: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/unmanaged/_test_context/GatewayClass-Gateway.3275374411.yaml] to ns in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:15.769170Z info tf === DONE (failed): Test: 'pilot[TestGateway/unmanaged] (68.490849ms)' === 2025-08-04T19:43:15.769354Z error tf === Dumping Namespace echo State for TestGateway/unmanaged... 2025-08-04T19:43:15.769378Z error tf === Dumping Istio Deployment State for TestGateway/unmanaged... 2025-08-04T19:43:15.769381Z error tf === Dumping Namespace external State for TestGateway/unmanaged... 2025-08-04T19:43:16.055904Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/615068c52d-b814-412f-a3af-da7fd8c3dcce 2025-08-04T19:43:16.056097Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2863s 2025-08-04T19:43:16.056722Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:16.241304Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/617421ef11-3ff0-4dc1-bffc-7941cb99dc67 2025-08-04T19:43:16.241482Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4716s 2025-08-04T19:43:16.242176Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:16.357754Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61e4dde684-f532-411e-9085-79b47657b02d 2025-08-04T19:43:16.357886Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5880s 2025-08-04T19:43:16.358503Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:16.859925Z error tf === Dumping Namespace istio-system State for TestGateway/unmanaged... === FAIL: tests/integration/pilot TestGateway/managed (0.89s) 2025-08-04T19:43:18.106295Z info tf === BEGIN: Test: 'pilot[TestGateway/managed]' === gateway_test.go:189: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/managed/_test_context/Gateway-HTTPRoute.2562765835.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:18.109302Z info tf === DONE (failed): Test: 'pilot[TestGateway/managed] (3.000534ms)' === 2025-08-04T19:43:18.109415Z error tf === Dumping Namespace echo State for TestGateway/managed... 2025-08-04T19:43:18.109426Z error tf === Dumping Istio Deployment State for TestGateway/managed... 2025-08-04T19:43:18.109432Z error tf === Dumping Namespace external State for TestGateway/managed... 2025-08-04T19:43:18.384867Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/6153247739-910a-4292-be24-f3810028dd68 2025-08-04T19:43:18.385039Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2753s 2025-08-04T19:43:18.385869Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:18.548595Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61106b1150-1bbe-4a37-a866-e09c53a95c5d 2025-08-04T19:43:18.548730Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4389s 2025-08-04T19:43:18.549512Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:18.716338Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:13Z/61ff6b0723-2f45-4bf4-9e6a-9cff434ef84f 2025-08-04T19:43:18.716515Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6067s 2025-08-04T19:43:18.717306Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway/tagged/gateway-connectivity-tagged-tag (1.05s) 2025-08-04T19:43:19.289413Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-tag]' === gateway_test.go:361: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/tagged/gateway-connectivity-tagged-tag/_test_context/Gateway-HTTPRoute.3834686547.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:19.292987Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-tag] (3.570424ms)' === 2025-08-04T19:43:19.293036Z error tf === Dumping Namespace echo State for TestGateway/tagged/gateway-connectivity-tagged-tag... 2025-08-04T19:43:19.293040Z error tf === Dumping Istio Deployment State for TestGateway/tagged/gateway-connectivity-tagged-tag... 2025-08-04T19:43:19.293078Z error tf === Dumping Namespace external State for TestGateway/tagged/gateway-connectivity-tagged-tag... 2025-08-04T19:43:19.641187Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:19Z/6275c361b9-15e4-4110-82ce-9cac28acbfd0 2025-08-04T19:43:19.641375Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3482s 2025-08-04T19:43:19.642262Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:19.798330Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:19Z/62533de74f-6804-4849-8a43-0b7d476598cd 2025-08-04T19:43:19.798440Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5052s 2025-08-04T19:43:19.799292Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:43:19.945173Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:43:19Z/620de40a22-1f0d-45d7-818e-e216fbe9e7fe 2025-08-04T19:43:19.945272Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6520s 2025-08-04T19:43:19.945919Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway/tagged/gateway-connectivity-tagged-badtag (0.01s) 2025-08-04T19:43:20.339946Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-badtag]' === gateway_test.go:361: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/tagged/gateway-connectivity-tagged-badtag/_test_context/Gateway-HTTPRoute.773132747.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:20.344660Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged/gateway-connectivity-tagged-badtag] (4.712782ms)' === === FAIL: tests/integration/pilot TestGateway/tagged (1.35s) 2025-08-04T19:43:18.993754Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged]' === 2025-08-04T19:43:19.158450Z info cluster "" kube client started 2025-08-04T19:43:19.259072Z info kube Starting Pilot K8S CRD controller controller=analysis-controller 2025-08-04T19:43:19.259168Z info kube Pilot K8S CRD controller synced in 90.414µs controller=analysis-controller 2025-08-04T19:43:19.259080Z info kube Starting Pilot K8S CRD controller controller=analysis-controller 2025-08-04T19:43:19.259206Z info kube Pilot K8S CRD controller synced in 125.545µs controller=analysis-controller 2025-08-04T19:43:19.288859Z info tf istioctl ([tag set tag --revision default]): completed after 0.2950s 2025-08-04T19:43:20.344721Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged] (1.350966507s)' === === FAIL: tests/integration/pilot TestGateway/managed-owner (6.44s) 2025-08-04T19:43:20.345006Z info tf === BEGIN: Test: 'pilot[TestGateway/managed-owner]' === 2025-08-04T19:43:20.416403Z info tf Checking pods ready... 2025-08-04T19:43:20.416440Z info tf Checking pods ready... 2025-08-04T19:43:20.459883Z info tf Failed retrieving pods: no matching pod found for selectors: [gateway.networking.k8s.io/gateway-name=managed-owner] 2025-08-04T19:43:20.660575Z info tf Checking pods ready... 2025-08-04T19:43:20.660649Z info tf Checking pods ready... 2025-08-04T19:43:20.667083Z info tf Failed retrieving pods: no matching pod found for selectors: [gateway.networking.k8s.io/gateway-name=managed-owner] 2025-08-04T19:43:21.067741Z info tf Checking pods ready... 2025-08-04T19:43:21.067798Z info tf Checking pods ready... 2025-08-04T19:43:21.073736Z info tf Failed retrieving pods: no matching pod found for selectors: [gateway.networking.k8s.io/gateway-name=managed-owner] 2025-08-04T19:43:21.874848Z info tf Checking pods ready... 2025-08-04T19:43:21.874918Z info tf Checking pods ready... 2025-08-04T19:43:21.892616Z info tf [ 0] managed-owner-istio-5cb6f544b4-kns4p Pending (Pending) 2025-08-04T19:43:23.492695Z info tf Checking pods ready... 2025-08-04T19:43:23.492825Z info tf Checking pods ready... 2025-08-04T19:43:23.499883Z info tf [ 0] managed-owner-istio-5cb6f544b4-kns4p Pending (Pending) 2025-08-04T19:43:26.700141Z info tf Checking pods ready... 2025-08-04T19:43:26.700262Z info tf Checking pods ready... 2025-08-04T19:43:26.709422Z info tf [ 0] managed-owner-istio-5cb6f544b4-kns4p Running (Ready) gateway_test.go:117: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/managed-owner/_test_context/Gateway.3102234163.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:26.713408Z info tf === DONE (failed): Test: 'pilot[TestGateway/managed-owner] (6.36839516s)' === === FAIL: tests/integration/pilot TestGateway/status (30.00s) 2025-08-04T19:43:26.788177Z info tf === BEGIN: Test: 'pilot[TestGateway/status]' === 2025-08-04T19:43:52.757375Z error port forward failed: lost connection to pod 2025-08-04T19:43:52.795746Z error port forward failed: lost connection to pod 2025-08-04T19:43:52.877614Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:43:52.885360Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:43:52.953379Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:43:52.956314Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success gateway_test.go:741: retry.UntilSuccessOrFail: timeout while waiting after 188 attempts (last error: failed to find accepted condition: {Type: Status: ObservedGeneration:0 LastTransitionTime:0001-01-01 00:00:00 +0000 UTC Reason: Message:}) 2025-08-04T19:43:56.788965Z info tf === DONE (failed): Test: 'pilot[TestGateway/status] (30.000786338s)' === === FAIL: tests/integration/pilot TestGateway/managed-short-name (0.00s) 2025-08-04T19:43:56.789379Z info tf === BEGIN: Test: 'pilot[TestGateway/managed-short-name]' === gateway_test.go:402: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestGateway/managed-short-name/_test_context/Gateway-HTTPRoute.3495175617.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:43:56.792464Z info tf === DONE (failed): Test: 'pilot[TestGateway/managed-short-name] (3.07992ms)' === === FAIL: tests/integration/pilot TestGateway (41.09s) 2025-08-04T19:43:15.700307Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T19:43:56.792522Z info tf === DONE (failed): Test: 'pilot[TestGateway] (41.092215009s)' === === FAIL: tests/integration/pilot TestProxyProtocolTCPGateway/filter/a (30.09s) 2025-08-04T19:44:08.843111Z info tf === BEGIN: Test: 'pilot[TestProxyProtocolTCPGateway/filter/a]' === traffic.go:245: failed calling naked (cluster=cluster-0)->'tcp://custom-gateway.custom-gateway.svc.cluster.local:80': call failed from naked (cluster=cluster-0) to tcp://custom-gateway.custom-gateway.svc.cluster.local:80 (using tcp): no responses received 2025-08-04T19:44:38.914866Z info tf === DONE (failed): Test: 'pilot[TestProxyProtocolTCPGateway/filter/a] (30.071752086s)' === === FAIL: tests/integration/pilot TestProxyProtocolTCPGateway/filter (30.09s) 2025-08-04T19:44:08.842251Z info tf === BEGIN: Test: 'pilot[TestProxyProtocolTCPGateway/filter]' === 2025-08-04T19:44:38.931786Z info tf === DONE (failed): Test: 'pilot[TestProxyProtocolTCPGateway/filter] (30.08952902s)' === === FAIL: tests/integration/pilot TestProxyProtocolTCPGateway (30.15s) 2025-08-04T19:44:08.791484Z info tf === BEGIN: Test: 'pilot[TestProxyProtocolTCPGateway]' === 2025-08-04T19:44:08.791526Z info tf === BEGIN: Create namespace custom-gateway === 2025-08-04T19:44:08.799170Z info tf === SUCCEEDED: Create namespace custom-gateway in 7.6347ms === 2025-08-04T19:44:08.826410Z info tf Checking pods ready... 2025-08-04T19:44:08.841730Z info tf [ 0] custom-gateway-6c777c7db9-b929d Running (Ready) 2025-08-04T19:44:38.931853Z info tf === DONE (failed): Test: 'pilot[TestProxyProtocolTCPGateway] (30.140369305s)' === === FAIL: tests/integration/pilot TestXfccHeaders (0.23s) 2025-08-04T19:44:47.419491Z info tf === BEGIN: Test: 'pilot[TestXfccHeaders]' === 2025-08-04T19:44:47.419529Z info tf === BEGIN: Create namespace proxy-headers === 2025-08-04T19:44:47.427835Z info tf === SUCCEEDED: Create namespace proxy-headers in 8.295725ms === 2025-08-04T19:44:47.450696Z info tf === BEGIN: Deploy echo instances === 2025-08-04T19:44:47.500253Z info klog Waiting for caches to sync controller=echo 2025-08-04T19:44:47.600761Z info klog Caches are synced controller=echo 2025-08-04T19:44:47.600864Z info tf === SUCCEEDED: Deploy echo instances in 150.164213ms === headers_test.go:238: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-66bd013f9aec45af937c656be/TestXfccHeaders/_test_context/ServiceEntry.2663853934.yaml] to ns proxy-headers in cluster cluster-0: apply: patch: serviceentries.networking.istio.io "external-service" is forbidden: unable to create new content in namespace proxy-headers because it is being terminated 2025-08-04T19:44:47.646723Z info tf === DONE (failed): Test: 'pilot[TestXfccHeaders] (227.225623ms)' === === FAIL: tests/integration/pilot TestTunnelingOutboundTraffic (600.34s) 2025-08-04T19:47:01.676850Z info tf === BEGIN: Test: 'pilot[TestTunnelingOutboundTraffic]' === 2025-08-04T19:47:01.910766Z info tf Checking pods ready... 2025-08-04T19:47:01.910819Z info tf Checking pods ready... 2025-08-04T19:47:01.915445Z info tf Failed retrieving pods: no matching pod found for selectors: [app=external-forward-proxy] 2025-08-04T19:47:02.116537Z info tf Checking pods ready... 2025-08-04T19:47:02.116643Z info tf Checking pods ready... 2025-08-04T19:47:02.121361Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:02.522486Z info tf Checking pods ready... 2025-08-04T19:47:02.522566Z info tf Checking pods ready... 2025-08-04T19:47:02.527197Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:03.327380Z info tf Checking pods ready... 2025-08-04T19:47:03.327502Z info tf Checking pods ready... 2025-08-04T19:47:03.350935Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:04.952109Z info tf Checking pods ready... 2025-08-04T19:47:04.952222Z info tf Checking pods ready... 2025-08-04T19:47:04.957485Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:08.158455Z info tf Checking pods ready... 2025-08-04T19:47:08.158612Z info tf Checking pods ready... 2025-08-04T19:47:08.318943Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:11.519884Z info tf Checking pods ready... 2025-08-04T19:47:11.519989Z info tf Checking pods ready... 2025-08-04T19:47:11.524403Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:12.962075Z error port forward failed: lost connection to pod 2025-08-04T19:47:13.037543Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:47:13.124828Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:47:13.176399Z error port forward failed: lost connection to pod 2025-08-04T19:47:13.389691Z error port forward failed: lost connection to pod 2025-08-04T19:47:13.520240Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:47:13.544204Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:47:13.590242Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:47:13.625388Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:47:14.725570Z info tf Checking pods ready... 2025-08-04T19:47:14.725656Z info tf Checking pods ready... 2025-08-04T19:47:14.731340Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:15.490198Z error port forward failed: lost connection to pod 2025-08-04T19:47:15.876798Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:47:15.954283Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:47:17.273205Z error port forward failed: lost connection to pod 2025-08-04T19:47:17.701974Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:47:17.761893Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:47:17.932430Z info tf Checking pods ready... 2025-08-04T19:47:17.932534Z info tf Checking pods ready... 2025-08-04T19:47:17.948036Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:18.243832Z error port forward failed: lost connection to pod 2025-08-04T19:47:18.621805Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:47:18.691438Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:47:21.148781Z info tf Checking pods ready... 2025-08-04T19:47:21.148856Z info tf Checking pods ready... 2025-08-04T19:47:21.153799Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:24.354649Z info tf Checking pods ready... 2025-08-04T19:47:24.354738Z info tf Checking pods ready... 2025-08-04T19:47:24.360176Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:27.560334Z info tf Checking pods ready... 2025-08-04T19:47:27.560393Z info tf Checking pods ready... 2025-08-04T19:47:27.564167Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:30.764284Z info tf Checking pods ready... 2025-08-04T19:47:30.764362Z info tf Checking pods ready... 2025-08-04T19:47:30.770044Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:33.971255Z info tf Checking pods ready... 2025-08-04T19:47:33.971344Z info tf Checking pods ready... 2025-08-04T19:47:33.975988Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:37.177108Z info tf Checking pods ready... 2025-08-04T19:47:37.177191Z info tf Checking pods ready... 2025-08-04T19:47:37.187060Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:40.388056Z info tf Checking pods ready... 2025-08-04T19:47:40.388157Z info tf Checking pods ready... 2025-08-04T19:47:40.392414Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:43.593612Z info tf Checking pods ready... 2025-08-04T19:47:43.593714Z info tf Checking pods ready... 2025-08-04T19:47:43.598621Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:46.799791Z info tf Checking pods ready... 2025-08-04T19:47:46.799845Z info tf Checking pods ready... 2025-08-04T19:47:46.814629Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:50.015787Z info tf Checking pods ready... 2025-08-04T19:47:50.015898Z info tf Checking pods ready... 2025-08-04T19:47:50.020544Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:50.665985Z error port forward failed: lost connection to pod 2025-08-04T19:47:51.095242Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:47:51.161712Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:47:51.287497Z error port forward failed: lost connection to pod 2025-08-04T19:47:51.364710Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:47:51.427803Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:47:53.221271Z info tf Checking pods ready... 2025-08-04T19:47:53.221353Z info tf Checking pods ready... 2025-08-04T19:47:53.225336Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:56.426202Z info tf Checking pods ready... 2025-08-04T19:47:56.426283Z info tf Checking pods ready... 2025-08-04T19:47:56.435006Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:47:59.635980Z info tf Checking pods ready... 2025-08-04T19:47:59.636054Z info tf Checking pods ready... 2025-08-04T19:47:59.641031Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:02.841792Z info tf Checking pods ready... 2025-08-04T19:48:02.841893Z info tf Checking pods ready... 2025-08-04T19:48:02.846262Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:06.046384Z info tf Checking pods ready... 2025-08-04T19:48:06.046463Z info tf Checking pods ready... 2025-08-04T19:48:06.053844Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:06.461657Z error port forward failed: lost connection to pod 2025-08-04T19:48:06.886294Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:48:06.962526Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:48:09.254635Z info tf Checking pods ready... 2025-08-04T19:48:09.254718Z info tf Checking pods ready... 2025-08-04T19:48:09.260644Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:12.461642Z info tf Checking pods ready... 2025-08-04T19:48:12.461730Z info tf Checking pods ready... 2025-08-04T19:48:12.465982Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:15.666776Z info tf Checking pods ready... 2025-08-04T19:48:15.666882Z info tf Checking pods ready... 2025-08-04T19:48:15.671710Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:18.872504Z info tf Checking pods ready... 2025-08-04T19:48:18.872557Z info tf Checking pods ready... 2025-08-04T19:48:18.880516Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:19.129137Z error port forward failed: lost connection to pod 2025-08-04T19:48:19.537736Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:48:19.593984Z error port forward failed: lost connection to pod 2025-08-04T19:48:19.621411Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:48:19.630398Z error port forward failed: lost connection to pod 2025-08-04T19:48:20.019935Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:48:20.043528Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:48:20.102834Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:48:20.133802Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:48:21.963750Z error port forward failed: lost connection to pod 2025-08-04T19:48:22.080929Z info tf Checking pods ready... 2025-08-04T19:48:22.081003Z info tf Checking pods ready... 2025-08-04T19:48:22.086434Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:22.376941Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:48:22.445310Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:48:23.766679Z error port forward failed: lost connection to pod 2025-08-04T19:48:24.202299Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:48:24.265144Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:48:24.696686Z error port forward failed: lost connection to pod 2025-08-04T19:48:25.120706Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:48:25.191620Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:48:25.287322Z info tf Checking pods ready... 2025-08-04T19:48:25.287421Z info tf Checking pods ready... 2025-08-04T19:48:25.292293Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:28.492783Z info tf Checking pods ready... 2025-08-04T19:48:28.492886Z info tf Checking pods ready... 2025-08-04T19:48:28.499022Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:31.699397Z info tf Checking pods ready... 2025-08-04T19:48:31.699456Z info tf Checking pods ready... 2025-08-04T19:48:31.703376Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:34.904328Z info tf Checking pods ready... 2025-08-04T19:48:34.904387Z info tf Checking pods ready... 2025-08-04T19:48:34.909725Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:38.110254Z info tf Checking pods ready... 2025-08-04T19:48:38.110346Z info tf Checking pods ready... 2025-08-04T19:48:38.117067Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:41.317570Z info tf Checking pods ready... 2025-08-04T19:48:41.317658Z info tf Checking pods ready... 2025-08-04T19:48:41.324284Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:44.525322Z info tf Checking pods ready... 2025-08-04T19:48:44.525387Z info tf Checking pods ready... 2025-08-04T19:48:44.532015Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:47.733033Z info tf Checking pods ready... 2025-08-04T19:48:47.733117Z info tf Checking pods ready... 2025-08-04T19:48:47.737862Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:50.938271Z info tf Checking pods ready... 2025-08-04T19:48:50.938315Z info tf Checking pods ready... 2025-08-04T19:48:50.945371Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:54.146073Z info tf Checking pods ready... 2025-08-04T19:48:54.146115Z info tf Checking pods ready... 2025-08-04T19:48:54.150954Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:57.166424Z error port forward failed: lost connection to pod 2025-08-04T19:48:57.351467Z info tf Checking pods ready... 2025-08-04T19:48:57.351563Z info tf Checking pods ready... 2025-08-04T19:48:57.363614Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:48:57.432046Z error port forward failed: lost connection to pod 2025-08-04T19:48:57.595430Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:48:57.658975Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:48:57.864439Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:48:57.929016Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:49:00.564240Z info tf Checking pods ready... 2025-08-04T19:49:00.564334Z info tf Checking pods ready... 2025-08-04T19:49:00.568677Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:03.769286Z info tf Checking pods ready... 2025-08-04T19:49:03.769377Z info tf Checking pods ready... 2025-08-04T19:49:03.775402Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:06.976289Z info tf Checking pods ready... 2025-08-04T19:49:06.976395Z info tf Checking pods ready... 2025-08-04T19:49:06.981475Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:10.182450Z info tf Checking pods ready... 2025-08-04T19:49:10.182492Z info tf Checking pods ready... 2025-08-04T19:49:10.187122Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:12.967640Z error port forward failed: lost connection to pod 2025-08-04T19:49:13.386351Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:49:13.387485Z info tf Checking pods ready... 2025-08-04T19:49:13.387523Z info tf Checking pods ready... 2025-08-04T19:49:13.395264Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:13.459861Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:49:16.596285Z info tf Checking pods ready... 2025-08-04T19:49:16.596345Z info tf Checking pods ready... 2025-08-04T19:49:16.601841Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:19.802800Z info tf Checking pods ready... 2025-08-04T19:49:19.802853Z info tf Checking pods ready... 2025-08-04T19:49:19.808227Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:23.008670Z info tf Checking pods ready... 2025-08-04T19:49:23.008708Z info tf Checking pods ready... 2025-08-04T19:49:23.012676Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:25.626292Z error port forward failed: lost connection to pod 2025-08-04T19:49:26.036791Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:49:26.106359Z error port forward failed: lost connection to pod 2025-08-04T19:49:26.110409Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:49:26.137005Z error port forward failed: lost connection to pod 2025-08-04T19:49:26.213107Z info tf Checking pods ready... 2025-08-04T19:49:26.213218Z info tf Checking pods ready... 2025-08-04T19:49:26.218065Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:26.520135Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:49:26.543818Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:49:26.583873Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:49:26.614117Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:49:28.450025Z error port forward failed: lost connection to pod 2025-08-04T19:49:28.877222Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:49:28.941765Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:49:29.418599Z info tf Checking pods ready... 2025-08-04T19:49:29.418674Z info tf Checking pods ready... 2025-08-04T19:49:29.425176Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:30.271756Z error port forward failed: lost connection to pod 2025-08-04T19:49:30.701720Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:49:30.760393Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:49:31.196668Z error port forward failed: lost connection to pod 2025-08-04T19:49:31.621085Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:49:31.759110Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:49:32.626078Z info tf Checking pods ready... 2025-08-04T19:49:32.626128Z info tf Checking pods ready... 2025-08-04T19:49:32.630206Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:35.830384Z info tf Checking pods ready... 2025-08-04T19:49:35.830449Z info tf Checking pods ready... 2025-08-04T19:49:35.836736Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:39.037655Z info tf Checking pods ready... 2025-08-04T19:49:39.037701Z info tf Checking pods ready... 2025-08-04T19:49:39.041633Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:42.242750Z info tf Checking pods ready... 2025-08-04T19:49:42.242801Z info tf Checking pods ready... 2025-08-04T19:49:42.246296Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:45.446772Z info tf Checking pods ready... 2025-08-04T19:49:45.446819Z info tf Checking pods ready... 2025-08-04T19:49:45.451084Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:48.651966Z info tf Checking pods ready... 2025-08-04T19:49:48.652005Z info tf Checking pods ready... 2025-08-04T19:49:48.655556Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:51.856674Z info tf Checking pods ready... 2025-08-04T19:49:51.856727Z info tf Checking pods ready... 2025-08-04T19:49:51.861364Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:55.062368Z info tf Checking pods ready... 2025-08-04T19:49:55.062425Z info tf Checking pods ready... 2025-08-04T19:49:55.066758Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:49:58.267125Z info tf Checking pods ready... 2025-08-04T19:49:58.267208Z info tf Checking pods ready... 2025-08-04T19:49:58.272426Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:01.472962Z info tf Checking pods ready... 2025-08-04T19:50:01.473020Z info tf Checking pods ready... 2025-08-04T19:50:01.477827Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:03.664227Z error port forward failed: lost connection to pod 2025-08-04T19:50:03.934229Z error port forward failed: lost connection to pod 2025-08-04T19:50:04.095123Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:50:04.150078Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:50:04.364295Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:50:04.435864Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:50:04.679004Z info tf Checking pods ready... 2025-08-04T19:50:04.679095Z info tf Checking pods ready... 2025-08-04T19:50:04.684002Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:07.885062Z info tf Checking pods ready... 2025-08-04T19:50:07.885136Z info tf Checking pods ready... 2025-08-04T19:50:07.889938Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:11.090495Z info tf Checking pods ready... 2025-08-04T19:50:11.090574Z info tf Checking pods ready... 2025-08-04T19:50:11.095318Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:14.295534Z info tf Checking pods ready... 2025-08-04T19:50:14.295574Z info tf Checking pods ready... 2025-08-04T19:50:14.299706Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:17.499860Z info tf Checking pods ready... 2025-08-04T19:50:17.499936Z info tf Checking pods ready... 2025-08-04T19:50:17.504561Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:19.464797Z error port forward failed: lost connection to pod 2025-08-04T19:50:19.885329Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:50:19.951560Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:50:20.704655Z info tf Checking pods ready... 2025-08-04T19:50:20.704704Z info tf Checking pods ready... 2025-08-04T19:50:20.710459Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:23.910887Z info tf Checking pods ready... 2025-08-04T19:50:23.910979Z info tf Checking pods ready... 2025-08-04T19:50:23.916011Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:27.116889Z info tf Checking pods ready... 2025-08-04T19:50:27.116970Z info tf Checking pods ready... 2025-08-04T19:50:27.121412Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:30.321715Z info tf Checking pods ready... 2025-08-04T19:50:30.321784Z info tf Checking pods ready... 2025-08-04T19:50:30.325969Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:32.115974Z error port forward failed: lost connection to pod 2025-08-04T19:50:32.537543Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:50:32.587736Z error port forward failed: lost connection to pod 2025-08-04T19:50:32.600357Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:50:32.620544Z error port forward failed: lost connection to pod 2025-08-04T19:50:33.020607Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:50:33.043426Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:50:33.083810Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:50:33.111620Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:50:33.526440Z info tf Checking pods ready... 2025-08-04T19:50:33.526518Z info tf Checking pods ready... 2025-08-04T19:50:33.534680Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:34.946821Z error port forward failed: lost connection to pod 2025-08-04T19:50:35.377543Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:50:35.461034Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:50:36.734881Z info tf Checking pods ready... 2025-08-04T19:50:36.734968Z info tf Checking pods ready... 2025-08-04T19:50:36.740391Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:36.764490Z error port forward failed: lost connection to pod 2025-08-04T19:50:37.202223Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:50:37.269948Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:50:37.764199Z error port forward failed: lost connection to pod 2025-08-04T19:50:38.121143Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:50:38.182052Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:50:39.941181Z info tf Checking pods ready... 2025-08-04T19:50:39.941236Z info tf Checking pods ready... 2025-08-04T19:50:39.946802Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:43.147479Z info tf Checking pods ready... 2025-08-04T19:50:43.147534Z info tf Checking pods ready... 2025-08-04T19:50:43.151589Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:46.352046Z info tf Checking pods ready... 2025-08-04T19:50:46.352115Z info tf Checking pods ready... 2025-08-04T19:50:46.359163Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:49.560059Z info tf Checking pods ready... 2025-08-04T19:50:49.560134Z info tf Checking pods ready... 2025-08-04T19:50:49.565175Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:52.765520Z info tf Checking pods ready... 2025-08-04T19:50:52.765573Z info tf Checking pods ready... 2025-08-04T19:50:52.778210Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:55.978448Z info tf Checking pods ready... 2025-08-04T19:50:55.978583Z info tf Checking pods ready... 2025-08-04T19:50:55.989286Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:50:59.190076Z info tf Checking pods ready... 2025-08-04T19:50:59.190162Z info tf Checking pods ready... 2025-08-04T19:50:59.194159Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:02.394528Z info tf Checking pods ready... 2025-08-04T19:51:02.394605Z info tf Checking pods ready... 2025-08-04T19:51:02.399668Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:05.600744Z info tf Checking pods ready... 2025-08-04T19:51:05.600851Z info tf Checking pods ready... 2025-08-04T19:51:05.610519Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:08.811026Z info tf Checking pods ready... 2025-08-04T19:51:08.811111Z info tf Checking pods ready... 2025-08-04T19:51:08.817339Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:10.155407Z error port forward failed: lost connection to pod 2025-08-04T19:51:10.439951Z error port forward failed: lost connection to pod 2025-08-04T19:51:10.594463Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:51:10.663856Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:51:10.864016Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:51:10.932285Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:51:12.018101Z info tf Checking pods ready... 2025-08-04T19:51:12.018157Z info tf Checking pods ready... 2025-08-04T19:51:12.021870Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:15.222960Z info tf Checking pods ready... 2025-08-04T19:51:15.223049Z info tf Checking pods ready... 2025-08-04T19:51:15.230844Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:18.431750Z info tf Checking pods ready... 2025-08-04T19:51:18.431810Z info tf Checking pods ready... 2025-08-04T19:51:18.436010Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:21.636576Z info tf Checking pods ready... 2025-08-04T19:51:21.636627Z info tf Checking pods ready... 2025-08-04T19:51:21.640326Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:24.841500Z info tf Checking pods ready... 2025-08-04T19:51:24.841591Z info tf Checking pods ready... 2025-08-04T19:51:24.845917Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:25.956524Z error port forward failed: lost connection to pod 2025-08-04T19:51:26.386253Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:51:26.444505Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:51:28.046840Z info tf Checking pods ready... 2025-08-04T19:51:28.046920Z info tf Checking pods ready... 2025-08-04T19:51:28.051710Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:31.252900Z info tf Checking pods ready... 2025-08-04T19:51:31.252960Z info tf Checking pods ready... 2025-08-04T19:51:31.257418Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:34.458417Z info tf Checking pods ready... 2025-08-04T19:51:34.458505Z info tf Checking pods ready... 2025-08-04T19:51:34.463672Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:37.664133Z info tf Checking pods ready... 2025-08-04T19:51:37.664255Z info tf Checking pods ready... 2025-08-04T19:51:37.669609Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:38.605674Z error port forward failed: lost connection to pod 2025-08-04T19:51:39.037189Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:51:39.089389Z error port forward failed: lost connection to pod 2025-08-04T19:51:39.105583Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:51:39.116113Z error port forward failed: lost connection to pod 2025-08-04T19:51:39.520299Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:51:39.543956Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:51:39.588656Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:51:39.612087Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:51:40.870671Z info tf Checking pods ready... 2025-08-04T19:51:40.870790Z info tf Checking pods ready... 2025-08-04T19:51:40.875755Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:41.466851Z error port forward failed: lost connection to pod 2025-08-04T19:51:41.876926Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:51:41.934145Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:51:43.274816Z error port forward failed: lost connection to pod 2025-08-04T19:51:43.702546Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:51:43.770824Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:51:44.076533Z info tf Checking pods ready... 2025-08-04T19:51:44.076610Z info tf Checking pods ready... 2025-08-04T19:51:44.081977Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:44.188678Z error port forward failed: lost connection to pod 2025-08-04T19:51:44.621392Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:51:44.693637Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:51:47.282998Z info tf Checking pods ready... 2025-08-04T19:51:47.283075Z info tf Checking pods ready... 2025-08-04T19:51:47.287145Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:50.488215Z info tf Checking pods ready... 2025-08-04T19:51:50.488252Z info tf Checking pods ready... 2025-08-04T19:51:50.492421Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:53.692531Z info tf Checking pods ready... 2025-08-04T19:51:53.692600Z info tf Checking pods ready... 2025-08-04T19:51:53.697559Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:51:56.898318Z info tf Checking pods ready... 2025-08-04T19:51:56.898397Z info tf Checking pods ready... 2025-08-04T19:51:56.903961Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:00.104735Z info tf Checking pods ready... 2025-08-04T19:52:00.104834Z info tf Checking pods ready... 2025-08-04T19:52:00.111888Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:03.313027Z info tf Checking pods ready... 2025-08-04T19:52:03.313146Z info tf Checking pods ready... 2025-08-04T19:52:03.341958Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:06.542204Z info tf Checking pods ready... 2025-08-04T19:52:06.542289Z info tf Checking pods ready... 2025-08-04T19:52:06.546907Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:09.747963Z info tf Checking pods ready... 2025-08-04T19:52:09.748048Z info tf Checking pods ready... 2025-08-04T19:52:09.754957Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:12.955122Z info tf Checking pods ready... 2025-08-04T19:52:12.955249Z info tf Checking pods ready... 2025-08-04T19:52:12.962855Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:16.163008Z info tf Checking pods ready... 2025-08-04T19:52:16.163098Z info tf Checking pods ready... 2025-08-04T19:52:16.168008Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:16.673051Z error port forward failed: lost connection to pod 2025-08-04T19:52:16.938498Z error port forward failed: lost connection to pod 2025-08-04T19:52:17.095186Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:52:17.168377Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:52:17.364098Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:52:17.428115Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:52:19.369098Z info tf Checking pods ready... 2025-08-04T19:52:19.369173Z info tf Checking pods ready... 2025-08-04T19:52:19.377185Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:22.577974Z info tf Checking pods ready... 2025-08-04T19:52:22.578076Z info tf Checking pods ready... 2025-08-04T19:52:22.582816Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:25.783410Z info tf Checking pods ready... 2025-08-04T19:52:25.783516Z info tf Checking pods ready... 2025-08-04T19:52:25.788719Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:28.989513Z info tf Checking pods ready... 2025-08-04T19:52:28.989624Z info tf Checking pods ready... 2025-08-04T19:52:28.993519Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:32.193940Z info tf Checking pods ready... 2025-08-04T19:52:32.193989Z info tf Checking pods ready... 2025-08-04T19:52:32.198236Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:32.448322Z error port forward failed: lost connection to pod 2025-08-04T19:52:32.885749Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:52:32.949899Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:52:35.399301Z info tf Checking pods ready... 2025-08-04T19:52:35.399352Z info tf Checking pods ready... 2025-08-04T19:52:35.403747Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:38.604264Z info tf Checking pods ready... 2025-08-04T19:52:38.604338Z info tf Checking pods ready... 2025-08-04T19:52:38.609473Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:41.810628Z info tf Checking pods ready... 2025-08-04T19:52:41.810706Z info tf Checking pods ready... 2025-08-04T19:52:41.814752Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:45.015916Z info tf Checking pods ready... 2025-08-04T19:52:45.015979Z info tf Checking pods ready... 2025-08-04T19:52:45.020536Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:45.111401Z error port forward failed: lost connection to pod 2025-08-04T19:52:45.537508Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:52:45.594323Z error port forward failed: lost connection to pod 2025-08-04T19:52:45.602491Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:52:45.617143Z error port forward failed: lost connection to pod 2025-08-04T19:52:46.020645Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:52:46.044061Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:52:46.123676Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:52:46.146032Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:52:47.940798Z error port forward failed: lost connection to pod 2025-08-04T19:52:48.221475Z info tf Checking pods ready... 2025-08-04T19:52:48.221567Z info tf Checking pods ready... 2025-08-04T19:52:48.225856Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:48.377405Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:52:48.480123Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:52:49.775163Z error port forward failed: lost connection to pod 2025-08-04T19:52:50.201726Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:52:50.267938Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:52:50.699226Z error port forward failed: lost connection to pod 2025-08-04T19:52:51.121537Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:52:51.198896Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:52:51.426273Z info tf Checking pods ready... 2025-08-04T19:52:51.426340Z info tf Checking pods ready... 2025-08-04T19:52:51.432006Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:54.632993Z info tf Checking pods ready... 2025-08-04T19:52:54.633053Z info tf Checking pods ready... 2025-08-04T19:52:54.637687Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:52:57.838373Z info tf Checking pods ready... 2025-08-04T19:52:57.838409Z info tf Checking pods ready... 2025-08-04T19:52:57.845424Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:01.045546Z info tf Checking pods ready... 2025-08-04T19:53:01.045619Z info tf Checking pods ready... 2025-08-04T19:53:01.051186Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:04.251401Z info tf Checking pods ready... 2025-08-04T19:53:04.251478Z info tf Checking pods ready... 2025-08-04T19:53:04.256394Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:07.456718Z info tf Checking pods ready... 2025-08-04T19:53:07.456777Z info tf Checking pods ready... 2025-08-04T19:53:07.462808Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:10.663509Z info tf Checking pods ready... 2025-08-04T19:53:10.663544Z info tf Checking pods ready... 2025-08-04T19:53:10.667461Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:13.867533Z info tf Checking pods ready... 2025-08-04T19:53:13.867604Z info tf Checking pods ready... 2025-08-04T19:53:13.874746Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:17.075307Z info tf Checking pods ready... 2025-08-04T19:53:17.075348Z info tf Checking pods ready... 2025-08-04T19:53:17.326046Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:20.526942Z info tf Checking pods ready... 2025-08-04T19:53:20.527074Z info tf Checking pods ready... 2025-08-04T19:53:21.008970Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:23.173498Z error port forward failed: lost connection to pod 2025-08-04T19:53:23.432845Z error port forward failed: lost connection to pod 2025-08-04T19:53:23.595402Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:53:23.728120Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:53:23.863893Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:53:23.932740Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:53:24.209356Z info tf Checking pods ready... 2025-08-04T19:53:24.209396Z info tf Checking pods ready... 2025-08-04T19:53:24.215104Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:27.415255Z info tf Checking pods ready... 2025-08-04T19:53:27.415295Z info tf Checking pods ready... 2025-08-04T19:53:27.419730Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:30.620437Z info tf Checking pods ready... 2025-08-04T19:53:30.620481Z info tf Checking pods ready... 2025-08-04T19:53:30.624558Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:33.825474Z info tf Checking pods ready... 2025-08-04T19:53:33.825548Z info tf Checking pods ready... 2025-08-04T19:53:33.830750Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:37.031172Z info tf Checking pods ready... 2025-08-04T19:53:37.031227Z info tf Checking pods ready... 2025-08-04T19:53:37.037240Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:38.955088Z error port forward failed: lost connection to pod 2025-08-04T19:53:39.385457Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:53:39.459948Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:53:40.238389Z info tf Checking pods ready... 2025-08-04T19:53:40.238455Z info tf Checking pods ready... 2025-08-04T19:53:40.242686Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:43.442840Z info tf Checking pods ready... 2025-08-04T19:53:43.442893Z info tf Checking pods ready... 2025-08-04T19:53:43.447533Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:46.648381Z info tf Checking pods ready... 2025-08-04T19:53:46.648446Z info tf Checking pods ready... 2025-08-04T19:53:46.654550Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:49.855748Z info tf Checking pods ready... 2025-08-04T19:53:49.855871Z info tf Checking pods ready... 2025-08-04T19:53:49.861146Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:51.608523Z error port forward failed: lost connection to pod 2025-08-04T19:53:52.037554Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:53:52.106754Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:53:52.128608Z error port forward failed: lost connection to pod 2025-08-04T19:53:52.161486Z error port forward failed: lost connection to pod 2025-08-04T19:53:52.520740Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:53:52.543200Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:53:52.601164Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:53:52.626608Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:53:53.061294Z info tf Checking pods ready... 2025-08-04T19:53:53.061410Z info tf Checking pods ready... 2025-08-04T19:53:53.065844Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:54.486191Z error port forward failed: lost connection to pod 2025-08-04T19:53:54.877487Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:53:54.963821Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:53:56.267083Z info tf Checking pods ready... 2025-08-04T19:53:56.267156Z info tf Checking pods ready... 2025-08-04T19:53:56.272319Z error port forward failed: lost connection to pod 2025-08-04T19:53:56.273749Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:53:56.701878Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:53:56.767773Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:53:57.205603Z error port forward failed: lost connection to pod 2025-08-04T19:53:57.621173Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:53:57.698455Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:53:59.474557Z info tf Checking pods ready... 2025-08-04T19:53:59.474673Z info tf Checking pods ready... 2025-08-04T19:53:59.488986Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:02.690143Z info tf Checking pods ready... 2025-08-04T19:54:02.690231Z info tf Checking pods ready... 2025-08-04T19:54:02.695481Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:05.896254Z info tf Checking pods ready... 2025-08-04T19:54:05.896314Z info tf Checking pods ready... 2025-08-04T19:54:05.901600Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:09.102748Z info tf Checking pods ready... 2025-08-04T19:54:09.102804Z info tf Checking pods ready... 2025-08-04T19:54:09.379015Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:12.579779Z info tf Checking pods ready... 2025-08-04T19:54:12.579827Z info tf Checking pods ready... 2025-08-04T19:54:12.589161Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:15.789525Z info tf Checking pods ready... 2025-08-04T19:54:15.789583Z info tf Checking pods ready... 2025-08-04T19:54:15.798053Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:18.998215Z info tf Checking pods ready... 2025-08-04T19:54:18.998272Z info tf Checking pods ready... 2025-08-04T19:54:19.002568Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:22.203238Z info tf Checking pods ready... 2025-08-04T19:54:22.203389Z info tf Checking pods ready... 2025-08-04T19:54:22.207946Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:25.408214Z info tf Checking pods ready... 2025-08-04T19:54:25.408329Z info tf Checking pods ready... 2025-08-04T19:54:25.412926Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:28.613054Z info tf Checking pods ready... 2025-08-04T19:54:28.613090Z info tf Checking pods ready... 2025-08-04T19:54:28.618734Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:29.733671Z error port forward failed: lost connection to pod 2025-08-04T19:54:29.936914Z error port forward failed: lost connection to pod 2025-08-04T19:54:30.094426Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:54:30.180337Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:54:30.364676Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:54:30.433898Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:54:31.818881Z info tf Checking pods ready... 2025-08-04T19:54:31.818947Z info tf Checking pods ready... 2025-08-04T19:54:31.823014Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:35.023643Z info tf Checking pods ready... 2025-08-04T19:54:35.023790Z info tf Checking pods ready... 2025-08-04T19:54:35.028402Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:38.229450Z info tf Checking pods ready... 2025-08-04T19:54:38.229527Z info tf Checking pods ready... 2025-08-04T19:54:38.234753Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:41.435534Z info tf Checking pods ready... 2025-08-04T19:54:41.435580Z info tf Checking pods ready... 2025-08-04T19:54:41.440976Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:44.642089Z info tf Checking pods ready... 2025-08-04T19:54:44.642129Z info tf Checking pods ready... 2025-08-04T19:54:44.646511Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:45.464618Z error port forward failed: lost connection to pod 2025-08-04T19:54:45.886397Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:54:45.956494Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:54:47.846622Z info tf Checking pods ready... 2025-08-04T19:54:47.846690Z info tf Checking pods ready... 2025-08-04T19:54:47.850784Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:51.051881Z info tf Checking pods ready... 2025-08-04T19:54:51.051928Z info tf Checking pods ready... 2025-08-04T19:54:51.058528Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:54.258940Z info tf Checking pods ready... 2025-08-04T19:54:54.258986Z info tf Checking pods ready... 2025-08-04T19:54:54.263218Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:57.464251Z info tf Checking pods ready... 2025-08-04T19:54:57.464292Z info tf Checking pods ready... 2025-08-04T19:54:57.468860Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:54:58.112824Z error port forward failed: lost connection to pod 2025-08-04T19:54:58.537234Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:54:58.605742Z error port forward failed: lost connection to pod 2025-08-04T19:54:58.616979Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:54:58.631421Z error port forward failed: lost connection to pod 2025-08-04T19:54:59.020774Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:54:59.043412Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:54:59.084627Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:54:59.105882Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:55:00.670031Z info tf Checking pods ready... 2025-08-04T19:55:00.670101Z info tf Checking pods ready... 2025-08-04T19:55:00.678953Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:00.969356Z error port forward failed: lost connection to pod 2025-08-04T19:55:01.377008Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:55:01.451507Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:55:02.774697Z error port forward failed: lost connection to pod 2025-08-04T19:55:03.202671Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:55:03.268861Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:55:03.703857Z error port forward failed: lost connection to pod 2025-08-04T19:55:03.879479Z info tf Checking pods ready... 2025-08-04T19:55:03.879532Z info tf Checking pods ready... 2025-08-04T19:55:03.884118Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:04.121393Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:55:04.179771Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:55:07.084840Z info tf Checking pods ready... 2025-08-04T19:55:07.084919Z info tf Checking pods ready... 2025-08-04T19:55:07.088887Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:10.290011Z info tf Checking pods ready... 2025-08-04T19:55:10.290100Z info tf Checking pods ready... 2025-08-04T19:55:10.294210Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:13.495171Z info tf Checking pods ready... 2025-08-04T19:55:13.495233Z info tf Checking pods ready... 2025-08-04T19:55:13.499948Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:16.701021Z info tf Checking pods ready... 2025-08-04T19:55:16.701105Z info tf Checking pods ready... 2025-08-04T19:55:16.705052Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:19.905748Z info tf Checking pods ready... 2025-08-04T19:55:19.905838Z info tf Checking pods ready... 2025-08-04T19:55:19.913519Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:23.114421Z info tf Checking pods ready... 2025-08-04T19:55:23.114490Z info tf Checking pods ready... 2025-08-04T19:55:23.120089Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:26.321276Z info tf Checking pods ready... 2025-08-04T19:55:26.321354Z info tf Checking pods ready... 2025-08-04T19:55:26.330633Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:29.531582Z info tf Checking pods ready... 2025-08-04T19:55:29.531689Z info tf Checking pods ready... 2025-08-04T19:55:29.538285Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:32.738990Z info tf Checking pods ready... 2025-08-04T19:55:32.739046Z info tf Checking pods ready... 2025-08-04T19:55:32.743611Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:35.943827Z info tf Checking pods ready... 2025-08-04T19:55:35.943936Z info tf Checking pods ready... 2025-08-04T19:55:35.952952Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:36.185323Z error port forward failed: lost connection to pod 2025-08-04T19:55:36.438490Z error port forward failed: lost connection to pod 2025-08-04T19:55:36.594646Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:55:36.679485Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:55:36.864766Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:55:36.928631Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:55:39.154099Z info tf Checking pods ready... 2025-08-04T19:55:39.154172Z info tf Checking pods ready... 2025-08-04T19:55:39.158775Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:42.359655Z info tf Checking pods ready... 2025-08-04T19:55:42.359754Z info tf Checking pods ready... 2025-08-04T19:55:42.364417Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:45.565168Z info tf Checking pods ready... 2025-08-04T19:55:45.565209Z info tf Checking pods ready... 2025-08-04T19:55:45.570212Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:48.771325Z info tf Checking pods ready... 2025-08-04T19:55:48.771382Z info tf Checking pods ready... 2025-08-04T19:55:48.775198Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:51.963291Z error port forward failed: lost connection to pod 2025-08-04T19:55:51.975857Z info tf Checking pods ready... 2025-08-04T19:55:51.975917Z info tf Checking pods ready... 2025-08-04T19:55:51.980486Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:52.385393Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:55:52.449992Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:55:55.181433Z info tf Checking pods ready... 2025-08-04T19:55:55.181490Z info tf Checking pods ready... 2025-08-04T19:55:55.186221Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:55:58.386288Z info tf Checking pods ready... 2025-08-04T19:55:58.386335Z info tf Checking pods ready... 2025-08-04T19:55:58.392790Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:01.593315Z info tf Checking pods ready... 2025-08-04T19:56:01.593360Z info tf Checking pods ready... 2025-08-04T19:56:01.597418Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:04.628460Z error port forward failed: lost connection to pod 2025-08-04T19:56:04.798293Z info tf Checking pods ready... 2025-08-04T19:56:04.798379Z info tf Checking pods ready... 2025-08-04T19:56:04.803119Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:05.037669Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward terminated 2025-08-04T19:56:05.089672Z error port forward failed: lost connection to pod 2025-08-04T19:56:05.106495Z warn pod: echo/headless-v1-5455bcc7b9-5hpbg port forward reconnect success 2025-08-04T19:56:05.110208Z error port forward failed: lost connection to pod 2025-08-04T19:56:05.520075Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward terminated 2025-08-04T19:56:05.543125Z warn pod: echo/statefulset-v1-0 port forward terminated 2025-08-04T19:56:05.598517Z warn pod: echo/proxyless-grpc-v1-759745c5b9-4wvdv port forward reconnect success 2025-08-04T19:56:05.628939Z warn pod: echo/statefulset-v1-0 port forward reconnect success 2025-08-04T19:56:07.456329Z error port forward failed: lost connection to pod 2025-08-04T19:56:07.877261Z warn pod: external/external-v1-987785fb7-swvxq port forward terminated 2025-08-04T19:56:07.960006Z warn pod: external/external-v1-987785fb7-swvxq port forward reconnect success 2025-08-04T19:56:08.003325Z info tf Checking pods ready... 2025-08-04T19:56:08.003405Z info tf Checking pods ready... 2025-08-04T19:56:08.007640Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:09.273996Z error port forward failed: lost connection to pod 2025-08-04T19:56:09.701685Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward terminated 2025-08-04T19:56:09.806894Z warn pod: echo/c-v1-5f56c57bb9-nzfdl port forward reconnect success 2025-08-04T19:56:10.185551Z error port forward failed: lost connection to pod 2025-08-04T19:56:10.621634Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward terminated 2025-08-04T19:56:10.694953Z warn pod: echo/sotw-v1-c494d6b8d-st2kk port forward reconnect success 2025-08-04T19:56:11.207965Z info tf Checking pods ready... 2025-08-04T19:56:11.208045Z info tf Checking pods ready... 2025-08-04T19:56:11.212643Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:14.413189Z info tf Checking pods ready... 2025-08-04T19:56:14.413243Z info tf Checking pods ready... 2025-08-04T19:56:14.418225Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:17.618679Z info tf Checking pods ready... 2025-08-04T19:56:17.618772Z info tf Checking pods ready... 2025-08-04T19:56:17.624708Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:20.825916Z info tf Checking pods ready... 2025-08-04T19:56:20.826028Z info tf Checking pods ready... 2025-08-04T19:56:20.842903Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:24.043636Z info tf Checking pods ready... 2025-08-04T19:56:24.043775Z info tf Checking pods ready... 2025-08-04T19:56:24.048546Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:27.249093Z info tf Checking pods ready... 2025-08-04T19:56:27.249160Z info tf Checking pods ready... 2025-08-04T19:56:27.253561Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:30.454118Z info tf Checking pods ready... 2025-08-04T19:56:30.454220Z info tf Checking pods ready... 2025-08-04T19:56:30.462083Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:33.662864Z info tf Checking pods ready... 2025-08-04T19:56:33.662951Z info tf Checking pods ready... 2025-08-04T19:56:33.668119Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:36.868271Z info tf Checking pods ready... 2025-08-04T19:56:36.868352Z info tf Checking pods ready... 2025-08-04T19:56:36.873020Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:40.074081Z info tf Checking pods ready... 2025-08-04T19:56:40.074152Z info tf Checking pods ready... 2025-08-04T19:56:40.079492Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:42.683862Z error port forward failed: lost connection to pod 2025-08-04T19:56:42.932059Z error port forward failed: lost connection to pod 2025-08-04T19:56:43.094976Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward terminated 2025-08-04T19:56:43.153857Z warn pod: echo/b-v1-5bccd7df8d-xksft port forward reconnect success 2025-08-04T19:56:43.280621Z info tf Checking pods ready... 2025-08-04T19:56:43.280695Z info tf Checking pods ready... 2025-08-04T19:56:43.284648Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:43.364679Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward terminated 2025-08-04T19:56:43.442865Z warn pod: echo/a-v1-6b586f9d47-dmjxt port forward reconnect success 2025-08-04T19:56:46.485041Z info tf Checking pods ready... 2025-08-04T19:56:46.485095Z info tf Checking pods ready... 2025-08-04T19:56:46.489188Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:49.690378Z info tf Checking pods ready... 2025-08-04T19:56:49.690454Z info tf Checking pods ready... 2025-08-04T19:56:49.695006Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:52.896145Z info tf Checking pods ready... 2025-08-04T19:56:52.896227Z info tf Checking pods ready... 2025-08-04T19:56:52.902391Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:56.103198Z info tf Checking pods ready... 2025-08-04T19:56:56.103281Z info tf Checking pods ready... 2025-08-04T19:56:56.107588Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) 2025-08-04T19:56:58.454973Z error port forward failed: lost connection to pod 2025-08-04T19:56:58.885939Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward terminated 2025-08-04T19:56:58.959361Z warn pod: echo/naked-v1-5bf694c455-trjsd port forward reconnect success 2025-08-04T19:56:59.307991Z info tf Checking pods ready... 2025-08-04T19:56:59.308050Z info tf Checking pods ready... 2025-08-04T19:56:59.313243Z info tf [ 0] external-forward-proxy-55d7b546bb-cmx2v Pending (Pending) tunneling_test.go:121: error getting external forward proxy ips: timeout while waiting after 190 attempts (last error: 1 error occurred: * external/external-forward-proxy-55d7b546bb-cmx2v: Pending ) 2025-08-04T19:57:01.911917Z info tf === DONE (failed): Test: 'pilot[TestTunnelingOutboundTraffic] (10m0.235059652s)' === === FAIL: tests/integration/pilot TestGateway/unmanaged (re-run 1) (3.34s) 2025-08-04T19:59:22.494952Z info tf === BEGIN: Test: 'pilot[TestGateway/unmanaged]' === gateway_test.go:621: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-82f8b69294d54b9d8041c4b0d/TestGateway/unmanaged/_test_context/GatewayClass-Gateway.4225568805.yaml] to ns in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T19:59:22.547096Z info tf === DONE (failed): Test: 'pilot[TestGateway/unmanaged] (52.139072ms)' === 2025-08-04T19:59:22.547200Z error tf === Dumping Namespace echo State for TestGateway/unmanaged... 2025-08-04T19:59:22.547225Z error tf === Dumping Istio Deployment State for TestGateway/unmanaged... 2025-08-04T19:59:22.547236Z error tf === Dumping Namespace external State for TestGateway/unmanaged... 2025-08-04T19:59:22.814123Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35627bc8ab8-6a5a-4e84-83af-25fd4251de24 2025-08-04T19:59:22.814294Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2668s 2025-08-04T19:59:22.814792Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:22.953454Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35634b9db82-31dd-4ab0-b7d5-256bafaff75a 2025-08-04T19:59:22.953566Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4061s 2025-08-04T19:59:22.954237Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:23.094638Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/356d3bb7de4-99f6-4d1c-9bd4-786ca033ee88 2025-08-04T19:59:23.094806Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5473s 2025-08-04T19:59:23.095624Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:23.400775Z warn tf cluster/pod cluster-0/echo/statefulset-v1-0 found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:23.426634Z warn tf cluster/pod cluster-0/echo/c-v1-5f56c57bb9-p2gcj found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:23.500995Z warn tf cluster/pod cluster-0/echo/b-v1-5bccd7df8d-rpfkw found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:23.572821Z warn tf cluster/pod cluster-0/echo/a-v1-6b586f9d47-mt2cn found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T19:59:25.185638Z error tf === Dumping Namespace istio-system State for TestGateway/unmanaged... === FAIL: tests/integration/pilot TestGateway (re-run 1) (4.34s) 2025-08-04T19:59:22.494733Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T19:59:25.836823Z info tf === DONE (failed): Test: 'pilot[TestGateway] (3.342083969s)' === 2025-08-04T19:59:25.836927Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T19:59:25.836927Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T19:59:25.836945Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T19:59:26.170177Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/35688c494e0-250f-464e-a469-af742b29ad70 2025-08-04T19:59:26.170368Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3331s 2025-08-04T19:59:26.171214Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:26.301652Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/356a94b3cdd-9d44-4611-bc9c-b41130d4a788 2025-08-04T19:59:26.301829Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4646s 2025-08-04T19:59:26.302638Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T19:59:26.456733Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T19:59:22Z/3565ec10ec5-1f39-4a4c-a9aa-5237594751c5 2025-08-04T19:59:26.456872Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.6196s 2025-08-04T19:59:26.457694Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway/tagged (re-run 1) (1.18s) 2025-08-04T20:00:09.556368Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged]' === 2025-08-04T20:00:09.585734Z info tf istioctl ([tag set tag --revision default]): completed after 0.0293s 2025-08-04T20:00:09.585828Z info tf istioctl error: Error: revision tag "tag" already exists, and --overwrite is false kube.go:122: Unwanted exception for 'istioctl tag set tag --revision default': revision tag "tag" already exists, and --overwrite is false kube.go:123: Output: kube.go:124: Error: Error: revision tag "tag" already exists, and --overwrite is false 2025-08-04T20:00:09.585972Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged] (29.597988ms)' === 2025-08-04T20:00:09.586047Z error tf === Dumping Namespace echo State for TestGateway/tagged... 2025-08-04T20:00:09.586047Z error tf === Dumping Namespace external State for TestGateway/tagged... 2025-08-04T20:00:09.586047Z error tf === Dumping Istio Deployment State for TestGateway/tagged... 2025-08-04T20:00:10.031711Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/37040a4b32d-ea27-4fd9-8461-237c0bcce1ed 2025-08-04T20:00:10.031953Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4452s 2025-08-04T20:00:10.032856Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:10.164250Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/370cf37c6b0-0ffb-4f57-9c80-b923d81e27d2 2025-08-04T20:00:10.164453Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5777s 2025-08-04T20:00:10.165324Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:10.324634Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/370ca5eff81-60d4-4768-b807-c77f3d7b0cf1 2025-08-04T20:00:10.324905Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.7381s 2025-08-04T20:00:10.325769Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway (re-run 1) (2.16s) 2025-08-04T20:00:09.554173Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:00:10.737174Z info tf === DONE (failed): Test: 'pilot[TestGateway] (1.182985995s)' === 2025-08-04T20:00:10.737341Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:00:10.737364Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:00:10.737358Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:00:11.103701Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/3709d14f13d-7810-4527-a9a8-65e1fc78b486 2025-08-04T20:00:11.103934Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3663s 2025-08-04T20:00:11.104877Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:11.243474Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/370de41062a-544e-486a-8f69-a17610c2dc0c 2025-08-04T20:00:11.243571Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5060s 2025-08-04T20:00:11.244197Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:11.382914Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:09Z/3709a163342-7a65-40ee-bce3-c511454b6414 2025-08-04T20:00:11.383165Z info tf istioctl ([x internal-debug --all configz]): completed after 0.6456s 2025-08-04T20:00:11.383696Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway/tagged (re-run 1) (2.71s) 2025-08-04T20:00:54.711733Z info tf === BEGIN: Test: 'pilot[TestGateway/tagged]' === 2025-08-04T20:00:54.730343Z info tf istioctl ([tag set tag --revision default]): completed after 0.0185s 2025-08-04T20:00:54.730370Z info tf istioctl error: Error: revision tag "tag" already exists, and --overwrite is false kube.go:122: Unwanted exception for 'istioctl tag set tag --revision default': revision tag "tag" already exists, and --overwrite is false kube.go:123: Output: kube.go:124: Error: Error: revision tag "tag" already exists, and --overwrite is false 2025-08-04T20:00:54.730477Z info tf === DONE (failed): Test: 'pilot[TestGateway/tagged] (18.739785ms)' === 2025-08-04T20:00:54.730527Z error tf === Dumping Namespace echo State for TestGateway/tagged... 2025-08-04T20:00:54.730535Z error tf === Dumping Istio Deployment State for TestGateway/tagged... 2025-08-04T20:00:54.730565Z error tf === Dumping Namespace external State for TestGateway/tagged... 2025-08-04T20:00:55.053977Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/38933846b81-dc52-45fa-8f9c-997c7f7d49e5 2025-08-04T20:00:55.054201Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3233s 2025-08-04T20:00:55.054870Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:55.220041Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/3899c355b3d-df8b-4076-9566-ad5d3b7c7406 2025-08-04T20:00:55.220179Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4893s 2025-08-04T20:00:55.221026Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:55.423404Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/38910a43e8f-0c70-48a3-a986-581d9a19e0b9 2025-08-04T20:00:55.423638Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6927s 2025-08-04T20:00:55.424426Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:55.785790Z warn tf cluster/pod cluster-0/echo/b-v1-5bccd7df8d-5dpvr found warming resources (dynamic_warming_clusters) on attempt 1 2025-08-04T20:00:55.848069Z warn tf cluster/pod cluster-0/echo/sotw-v1-c494d6b8d-5x4f4 found warming resources (dynamic_warming_clusters) on attempt 1 === FAIL: tests/integration/pilot TestGateway (re-run 1) (3.85s) 2025-08-04T20:00:54.711462Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:00:57.421411Z info tf === DONE (failed): Test: 'pilot[TestGateway] (2.709942773s)' === 2025-08-04T20:00:57.421500Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:00:57.421516Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:00:57.421513Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:00:57.780360Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/3896aa6d253-8268-49cd-b315-cb95975605c9 2025-08-04T20:00:57.780618Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3589s 2025-08-04T20:00:57.781196Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:57.987552Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/3892144b562-0b9e-46f3-a57b-40771a5a802d 2025-08-04T20:00:57.987729Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5659s 2025-08-04T20:00:57.988514Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:00:58.187060Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:00:54Z/389fce9c7b0-3f06-4b31-9ee1-0fd900495c9c 2025-08-04T20:00:58.187248Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.7654s 2025-08-04T20:00:58.187945Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway/status (re-run 1) (31.29s) 2025-08-04T20:01:38.932951Z info tf === BEGIN: Test: 'pilot[TestGateway/status]' === gateway_test.go:741: retry.UntilSuccessOrFail: timeout while waiting after 188 attempts (last error: failed to find accepted condition: {Type: Status: ObservedGeneration:0 LastTransitionTime:0001-01-01 00:00:00 +0000 UTC Reason: Message:}) 2025-08-04T20:02:08.933561Z info tf === DONE (failed): Test: 'pilot[TestGateway/status] (30.000603546s)' === 2025-08-04T20:02:08.933694Z error tf === Dumping Namespace echo State for TestGateway/status... 2025-08-04T20:02:08.933728Z error tf === Dumping Istio Deployment State for TestGateway/status... 2025-08-04T20:02:08.933720Z error tf === Dumping Namespace external State for TestGateway/status... 2025-08-04T20:02:09.322292Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/4055f373d8f-c1d2-4884-ba8f-045e2265e6c5 2025-08-04T20:02:09.322459Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3883s 2025-08-04T20:02:09.323147Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:09.467286Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/4057cd6c6f2-df79-4414-a109-1373c2456a9e 2025-08-04T20:02:09.467422Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.5332s 2025-08-04T20:02:09.468143Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:09.615905Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/405fe7dc5cd-a773-43f1-a677-e02fce0d084a 2025-08-04T20:02:09.616045Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6818s 2025-08-04T20:02:09.616572Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway (re-run 1) (32.33s) 2025-08-04T20:01:38.932671Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:02:10.225045Z info tf === DONE (failed): Test: 'pilot[TestGateway] (31.292362837s)' === 2025-08-04T20:02:10.225195Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:02:10.225203Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:02:10.225205Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:02:10.483318Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/4055ad26b64-1f85-4e9b-9c2f-dae701c8f445 2025-08-04T20:02:10.483465Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2580s 2025-08-04T20:02:10.484243Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:10.632772Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/405906328bb-2801-4396-b36d-d796b510c4a6 2025-08-04T20:02:10.632961Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4075s 2025-08-04T20:02:10.633692Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:02:10.834623Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:01:39Z/405e5a976d6-e660-492d-b73a-b7ee0c5c70ea 2025-08-04T20:02:10.834778Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6093s 2025-08-04T20:02:10.835520Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/pilot TestGateway/unmanaged (re-run 2) (1.91s) 2025-08-04T20:04:38.419398Z info tf === BEGIN: Test: 'pilot[TestGateway/unmanaged]' === gateway_test.go:621: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/pilot/artifacts/pilot-3aa8bd7c1c524ac8bbb74155e/TestGateway/unmanaged/_test_context/HTTPRoute-TCPRoute-GRPCRoute-ReferenceGrant.278508989.yaml] to ns echo in cluster cluster-0: apply: patch: the server could not find the requested resource 2025-08-04T20:04:38.525010Z info tf === DONE (failed): Test: 'pilot[TestGateway/unmanaged] (105.606448ms)' === 2025-08-04T20:04:38.525089Z error tf === Dumping Istio Deployment State for TestGateway/unmanaged... 2025-08-04T20:04:38.525093Z error tf === Dumping Namespace echo State for TestGateway/unmanaged... 2025-08-04T20:04:38.525107Z error tf === Dumping Namespace external State for TestGateway/unmanaged... 2025-08-04T20:04:38.847109Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/4506c6841f0-8a92-4227-bd68-225c729af4b6 2025-08-04T20:04:38.847252Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3220s 2025-08-04T20:04:38.848096Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:39.073968Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/45023676008-dba7-42ba-af2f-7d14f4b03d7a 2025-08-04T20:04:39.074073Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5487s 2025-08-04T20:04:39.075022Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:39.269045Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/4509525d3ad-b003-46cb-bcc3-f73aaa3ed561 2025-08-04T20:04:39.269200Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.7438s 2025-08-04T20:04:39.270200Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:39.582686Z error tf === Dumping Namespace istio-system State for TestGateway/unmanaged... === FAIL: tests/integration/pilot TestGateway (re-run 2) (2.96s) 2025-08-04T20:04:38.419215Z info tf === BEGIN: Test: 'pilot[TestGateway]' === 2025-08-04T20:04:40.327519Z info tf === DONE (failed): Test: 'pilot[TestGateway] (1.908299643s)' === 2025-08-04T20:04:40.327624Z error tf === Dumping Namespace echo State for TestGateway... 2025-08-04T20:04:40.327634Z error tf === Dumping Istio Deployment State for TestGateway... 2025-08-04T20:04:40.327643Z error tf === Dumping Namespace external State for TestGateway... 2025-08-04T20:04:40.656429Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/450dc8cf574-bbe1-4c12-bb7e-367032a5c252 2025-08-04T20:04:40.656710Z info tf istioctl ([x internal-debug --all configz]): completed after 0.3287s 2025-08-04T20:04:40.657383Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:40.797424Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/4508a1ada96-d784-442e-9672-5443db901574 2025-08-04T20:04:40.797586Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4694s 2025-08-04T20:04:40.798372Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-08-04T20:04:40.956233Z info adsc Received type=istio.io/debug count=1 nonce=2025-08-04T20:04:38Z/450435b623b-93c0-4084-a578-4c7ffe18bdff 2025-08-04T20:04:40.956425Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.6282s 2025-08-04T20:04:40.957241Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF DONE 3 runs, 748 tests, 52 skipped, 30 failures in 1463.669s exec: go version